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Preface 


This textbook aimed at the advanced undergraduate and graduate readership is devoted to 
a systematic account of the fundamentals of the Bayes theory of statistical estimation with 
applications to the analysis of engineering reliability. Lately, there has been a significant 
trend toward using the Bayesian approach to develop and analyze problems in different 
fields of our society. At the same time, the Bayes theory is characterized by an inner logi- 
cal harmony and simplicity which makes it still more attractive for applied purposes. The 
application of the bayes theory and methods in the field of reliability gives us the opportu- 
nity to save money and time assigned for experiments owing to utilization of relevant prior 
information instead of the corresponding number of trials. 


The subject matter of the book pursues the following double aim: 


1. To give an account of the present state of the Bayes theory and methods with emphasis 
on application. 

2. To demonstrate how we can use the Bayes approach for the evaluation of the reliability 
function in the calculations of reliability which, in practice, covers a great variety of the 


problems of statistical analysis of engineering reliability. 


The distinguishing feature of this monograph is a close unity of fundamental investigation 
of the main principles of the Bayes theory with clear presentation of its practical applica- 
tions. The rendering of the fundamentals of the Bayes methodology follows the classical 
works by Ramsey, Good, Savage, Jefferys, and De Groot, while its present state is repre- 
sented by the results produced during the last 30 years by a number of scientists from the 
U.S.A., Canada and countries of Western Europe. The greater part of the monograph is 
comprised of the presentation of new and original results of the author, the most significant 
of which are Bayes quasi-parametric estimators, Bayes relative minimax estimators un- 


der the conditions of a partial prior information, and the estimators of the working capacity 
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with an additive error. The Bayes procedures suggested in the monograph are distinguished 
by a simple way of representation of prior information and use of censored samples that 
undoubtedly testify to their practical usefulness. The subject methodology presented in this 
monograph is illustrated with a great number of examples. 

Chapter | of the monograph plays the role of an introduction and is, in fact, a brief excur- 
sion into the history of the Bayes approach. The general principles of the Bayes approach 
and hierarchical Bayes methodology are discussed in this chapter. Also included are the 
varieties of subjective probability constructions, as well as an application of the Bayes 
methodology in the reliability field. 

Chapter 2 describes the components of the Bayes approach. In particular, forms of loss 
functions, choice of the prior probability distribution and the general procedure of reliabil- 
ity estimation are considered. 

A systematic description of accepted estimation procedures is given in Chapter 3. The 
authors demonstrate the process of solving the problems of survival probability estimation 
from accelerated life tests. 

Chapter 4 is devoted to non-parametric Bayes estimation which, in our opinion, is the front 
line of Bayes theory. Nonparametric Bayes estimators in which the Dirichlet processes are 
not used are discussed. The authors also consider the nonparametric bayes approach of 
quantile estimation for increasing failure rate. 

A detailed presentation of a new method called “quasi-parametric” is given in Chapter 5. 
Bayes estimators of a reliability function for a restricted increasing failure rate distribution 
are studied. 

Chapter 6 deals with the class of Bayes estimators of a reliability function under the con- 
ditions of partial prior information. The setting of the problem and its general solution that 
yields a new type of estimator are considered. 

Chapter 7 is devoted to empirical Bayes estimators first suggested by Robins. The main 
results are described briefly. The authors present a new method based on the idea of quasi- 
parametrical estimation. 

Chapters 8-10 are united by common contents that are based on a reliability estimation 
using functional models of working capacity. 

The monograph is addressed (first and foremost) to practicing scientists, though it also 
deals with a number of theoretical problems. The monograph is a blend of thorough, 
mathematically-strict presentations of the subject matter and it is easily readable. The 


monograph can be a useful, authoritative and fundamental source of reference for training 
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Chapter 1 


General Questions of Bayes Theory 


1.1. A brief excursus into the history of the Bayes approach 


The Bayes approach is credited to the well-known paper by Thomas Bayes which was 
published. Nearly three years after his death. G. Crellin asserts [50] that the Bayes notes 
concerned with the ideas touching upon the field, named the Bayes approach, were dis- 
covered by Richard Price, who sent them to the Royal Society under the title “Note on 
the Solution of a Problem in a Doctrine about an Event”. A current account of this paper 
can be found in [13]. R.A. Fisher [84] gives an analysis of Bayes’ work in terms we use 
now. Later, some of the opponents of the Bayes approach ascertained that this work was 
not published in his lifetime because of Bayes’ doubt about the validity of the conclusions 
proposed in it. Such a point-of-view about an event which happened more than 200 years 
ago may be considered at least strange and, in any case, cannot be used as an argument in 
a scientific dispute. 

We now turn our attention to the importance of the Bayes Theory foundations. In the second 
part of his work (the first one does not have any new ideas), Bayes considers a speculative 
trial with a successive rolling of two balls. The rolling of the first ball corresponds to some 
number from the interval {0,1}. The rolling of the second ball forms the sequence of 


binomial outcomes with the probabilities of success p and failure (1 — p) for each trial. 


Suppose that X is the number of successes and Y the number of failures. Then we can write 
P2 n! a b 
Pipi <p<pa,X=a,¥ =b}= f —iiliducae) dp. (1.1) 
p, alb! 
Putting p; = 0, p2 = 1 in (1.1) we obtain 
pes == ff nl 4a(1 = pyrdp = — (1.2) 
a ey 


Thus, the parameter p is assumed to be random and the probability of the event of p being in 


the interval dp is proportional to the length of this segment. In other words, p is distributed 
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uniformly in [0.1]. This fact is also emphasized by the corollary of (1.2) which asserts 
the probability of observing a successes and / failures is a priori independent of the values 
of a and b but depends on the sum of a and b. The property of uniformness of the prior 
distribution appears to be somewhat obscure in the Bayes work and is often disregarded. 
This problem is the subject of the special analysis in the work by A. Edwards [72]. 

The following Bayes lemma determines the conditional posterior probability of a random 


parameter p falling into some interval [p,, p2]: 


n+)! p2 


Ae ae p7(1—p)’dp. (1.3) 


a'b! 


1.2. The Philosophy of the Bayes Approach 


Philosophic aspects of Bayes theory can be separated into two groups dealing with: |) the 
relationship between inductive and deductive ways of thinking: and 2) the interpretation of 
probability. 

The deductive approach of thinking played a major role in scientific practice during the 
time of formation of the Bayes method. Bayes results have actually shown how one can 
transform the inductive judgement problem into the problem of probability. 

At the present time, the question of the relationship between induction and deduction is 
being solved more seriously and completely using Bayes theory Jeffreys book [115] gives 
a complete analysis of the relationship between induction and deduction. including the 
leading role of the Bayes approach. 

Jeffrey’s discusses two basic arguments. First, the deductive method itself cannot build an 
adequate base for all possible conclusions of any applied science. The second argument of 
Jeffrey's leans in favor of the arbitrarily-takennon-uniqueness of the tool of deductive logic 
is that for any drawn observation set there exists a huge number of describing laws. 
Broader choice principles are necessary. One of them is the simplicity principle of “Oc- 
cam’s” blade [275]. Therefore, deductive thinking is a very important clement of any sci- 
entific conclusion of learning experience, Knowledge obtained this way partially contains 
the results of previous observations that are going to be used for the prediction of a future 
result. Jeffrey’s calls this part of knowledge a generalization or induction. Jeffreys consid- 
ers deductive logic as a special case of inductive logic. Two basic terms “true” and “false” 
are limit cases of the values given by the inductive logic. 

Thus, according to Jeffrey’s, the main part of induction is a generalization of previous ex- 


perience and empirical data for the purpose of analysis of observable events and prediction 
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of future events. To order the induction process Jeffrey’s states eight rules (five basic and 


three auxiliary): 


1. All the hypotheses must be clearly stated and all conclusions must be derived only from 
these hypotheses. 

2. An inductive theory must not be self-contradictory. 

3. Any given law must be practically doable. The definition is useless unless the object 
defined can be recognized with this definition. 

4. An inductive theory must consider the possibility of the fact that conclusions derived 
with this theory may be wrong. 

5. Inductive theory must not reject empirical observation “a-priori’. 
The other three auxiliary rules carry the following sense. 

6. The number of postulates must be minimized. 

7. Although we do not consider the human brain as a perfect thinking instrument, we have 
to accept it as useful and as the only one available. 

8. Taking into account the complexity of induction, we cannot hope to develop it better 
than deduction. Therefore, we should discard any statement that contradicts one of pure 


mathematics. 


As suggested by Jeffrey’s, induction theory looks reasonable and has obvious practical 
value. However, if we had accepted it as a starting point, we would have come to a contra- 
diction with the most common “frequency” interpretation of probability. 

Let us note that from the point of view of mathematics, probability is the function of the 
set satisfying the axioms of general measure theory. In order to apply the theorems of 
mathematical probability (including Bayes theory), it is enough to accept the fact that those 
axioms are fulfilled. At the same time, all the conclusions can have different interpretations 
depending on the sense of the initial definition of probability. 

There are two poles of the probability theory: objective and subjective probability. In the 
objective sense, a probability of an event A is considered together with the fulfilment of 
certain conditions [90]. We should select two things here: first, principal regeneration; 
and second, an infinite number of experiments with conditions remaining constant. Both 
attributes a rein direct contradiction with the third rule of Jeffrey’s. In other words, it 
becomes unacceptable to describe real or possible events by the objective definition of 
probability. 

In the subjective sense, probability is a qualitative estimate of the possibility of the event 


given, for example, by the individual experience of the investigator. Subjective probability 
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is adequate to the theory of inductive conclusions and satisfies the axioms of probability at 
the same time. It is evident that all the trust levels are very approximate. 

Considering the relationship between two interpretations of probability.it is necessary to 
investigate two important questions. The first approaches concerned with the notion of 
randomness associated with the Bayes approach, the second with studying the real meaning 
of the term “objective”. 

The existing disagreements between “subjectivists” and “objectivists” are of a mostly ter- 
minological nature. As a matter of fact, when talking about probability. people always 
mean frequency. 

All the philosophical questions considered in this section justify the use of Bayes’ approach 
as a general system of inductive thinking, and explain the irrelevance of the approach of 


scientists who firmly stand on objectivist positions. 


1.3. The General Principles of Bayes Methodology 


We understand the methodology of the Bayes approach as a collection of constructing 
principles, forms and learning methods. Let us first try to understand the basics of Baves 
theory. Often when talking about only Bayes theory people think about only certain aspects 
of it. At the same time, the modern understanding of Bayes approach is a complete theory 


naturally containing the following statements. 


Statement 1. The parameter of the system studied is random. Moreover, the “randomness” 
is understood not only in a general sense but also as “uncertainty”. A random parameter is 


assigned prior distribution. 


Statement 2. All the observed results and the prior distribution are unified by the Bayes 


theorem in order to obtain a posterior distribution parameter. 


Statement 3. A statistical conclusion or decision rule is accepted with a condition of 
maximal estimated utility, in particular, the minimization of loss related to this rule. 


We shall consider all these statements separately. 


1.3.1 Possible interpretations of probability 


Unlike classical estimate theory dealing with non-random parameters, Bayes’theory as- 
sumes random parameters. This randomness is understood in a general sense, when the 


values of the parameter are generated by the stable real mechanism with known properties 
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or properties that can be obtained by the study of corresponding data. 

In most of the cases involving technical problems, all the parameters of the system or 
model are constants of the special kind that represent in certain idealized form some inner 
properties of the system or model studied. The meaning of uncertainty can be easily seen 
in the following example. The correlation between two physical values that are random 
in a classical sense is studied. The coefficient of the correlation describes the correlation 
itself and is an adequate characteristic of correlation. However, it is impossible to find, 
more or less, its precise value without conducting a large number of experiments. From 
previous experience, we know that this coefficient is non-negative. Hence, we conclude 
that the coefficient is contained in the interval [0, 1] and we don’t know which value in this 
interval it takes. How can we measure its uncertainty? What mathematical instrument can 
adequately characterize it? One of the possible variants is Jeffrey’s’ approach based on 
rational levels of certainty. 

An interpretation of judgment in Bayes methodology always has a probabilistic nature. 
However, randomness is considered not only in a classical sense but also as uncertainty. 


Probabilistic judgment can be one of three types: 


1. By means of objective probability interpretation; 

2. By means of rational levels of certainty that mostly are reduced to a mathematical rep- 
resentation of the absence of prior knowledge; 

3. By means of subjective levels of confidence that represent the personal relation of the 


investigator to the event or system being studied. 


All these areas of study in practice do not overlap. 


1.3.2. A union of prior information and empirical data 


Bayes theorem gives us the base to transfer from prior to posterior information by adding 
empirical data. This process can be represented as a consequent gathering of information. 
At the initial stage of study, one has certain information about the properties of the system 
being studied based on previous experience. Except for non-formal experience, this con- 
tains empirical data obtained before conducting a similar experiment. During the testing 
the investigator collects new information that changes his judgment about the system prop- 
erties. By doing this, he reconsiders and re-evaluates his prior information. Moreover, at 
any moment of time we describe the system properties, and this description is complete in 


a sense that we used all the information available. This process does not stop; it continues 


6 Bayesian Theory and Methods with Applications 


with every new empirical result. 

Zelner’s probability reconsideration diagram [275] is very illustrative, see Fig. 1.1. Let 
system properties be represented by, generally speaking, vector parameter 0: /, stands for 
the initial information. Formalization of initial information is done by recording prior pa- 
rameter distribution, which is conditional to /, that is, #(@ /,). All empirical data collected 
during the test are formalized by the “likelihood” function /(6 | x). The former represents 
the probability (or probability density) of the empirical data observed and written as a func- 
tion of the parameter. Essentially, to get £(@ | x) we need to know the model of the system 
as a conditional probability distribution of a random variable or some other representation. 


Bayes’ theorem, by means of the transformation 


Initial A Priori 


Information J, distribution 
h(@ | fa) 


A Posteriori 
distribution 
h(@ | Ia) 


Bayes 
Theorem 


Truthfulness 
function 
h(@ | x) 


Fig. 1.1 Zelner’s probability reconsiderations diagram. 


A(O | x, Ia)€(9 | x) 


i\6(.,) eae 
[nce | x, Ine(0 | x\d0 


allows us to obtain posterior probability distribution of the parameter 6 :(@  x./,), that is 
conditional with respect to the initial information /,, and empirical data x. 

The more information we collect, the more it dominates in the posterior distribution. The 
distribution density accumulates near the true value of the parameter. If two investigators 
used different prior information, their a posterior distributions get closer and closer to each 
other. 

This pattern is called an orthodox Bayes procedure. Its difference from other modifications 
is that the prior distribution remains the same during the collection of empirical data. This 


property was mentioned by De Finetti [61]. 
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Limer [140] gives a more complicated modification of the orthodox scheme that assumes a 
possibility of correction of prior confidence levels, see Figure 1.2. 

This modification is called rational Bayes procedure. The main feature of both Bayes 
procedures, orthodox and rational, is that they always can be used for concrete calculations 


and for the purposes of applying it to a broad spectrum of problems. 


1.3.3. Optimality of Bayes estimation rules 


The final result of all Bayes procedures described above is the posterior of the distribution 
parameter characterizing the basic properties of the system or event under study. This dis- 
tribution gives a clear and complete description of the parameter uncertainty. However, in 
many situations it is necessary to have a shorter decision rule giving a parameter description 
of one or several constants estimating an unknown parameter. Examples of such constants 
are point estimates and Bayes confidence limits. 

In a Bayes approach the difference between the parameter and its estimate can be found 
in its utility function. The former characterizes losses that appear as a consequence of 
substitution of the true parameter value by its estimate. The estimation rule is chosen so 
that it minimizes the mathematical expectation of the loss function. This rule is general for 
all problems of estimation theory, which is a great advantage of the Bayes approach. 

The decision function which minimizes the expected losses is called by Vald [257] an 


optimal Bayes solution with respect to the chosen prior distribution. 


1.4 Subjective probabilities 


The Bayes approach is based essentially on subjective probabilities and, due to this, the 
conceptions of these probabilities are a part of the Bayes methodology. Below we con- 
sider the foundations of the theory of subjective probabilities in connection with the Bayes 
approach. 

It was Jacob Bernulli who proposed, for the first time, to treat probabilities as degrees or 
levels of confidence. This point-of-view appears in his book “The Skills of Assumptions” 
which was published in 1713, eight years after his death. In the 19th Century, De Morgan 
promoted the doctrine that a probability is not an objective characteristic of the external 
universe, but a subjective quantity which may change from subject to subject. Further 
development of the theory of subjective probabilities was obtained in the works by Ramsey 


[203], De Finetti [61], Koopman [126], Savage [216], De Groot [63] and other authors. 
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Choice of working 
hypothesis and 
correspondent trust 
levels 


Previous 
experience 


A posteriori 
distribution 


Is the set of 
working 
hypothesis 
complete? 


Simplification of 
Working hypothesis 


Fig. 1.2. Limer scheme. 


Here we set forth the main principles of this theory in accordance with the works by De 
Finneti and De Groot. 

For the ordering of confidence levels we introduce axiomatically the notion of the relalive 
likelihood of an event (or a proposition) compared to another one. Further, A < B indicates 
that the event A is more probable than the event B: the notation A ~ B is used for events with 
the same likelihoods. Probability, starting from an intuitive point of view, is a numerical 
measure of the likelihood of an event A. A probability distribution, having been given. not 
only points out the difference in likelihoods of two events, but also indicates how much one 
of the events is more probable than another. 


It is important that a probability distribution be consistent with the relation <. For any 
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probability distribution, defined on o-algebra of the events, the property of consistency 
means that P{A} < P{B} iff A < B. Let us suppose that the relation is subjected to the 


following requirements. 


|) For any two events A and B, one and only one of the following relations takes place: 
A~<B,B<A,A~B. 

2) If, for A;, Az, By), By, we have Aj NA2 = By N Bo = O and A; < B;, then Aj UA2 < By UB. 
If, in addition to this, Ay < B, or Az ~ Bo, then Ay UA? ~ By UB>. 

3) Whatever an event A will be, @ < A. Moreover, 8 < Q, where Q is a sample space. 

4) If Aj > A2... is a decreasing sequence of events, besides A; > B;, i= 1,2,..., where B 


is some fixed event, then U?_, A; > B. 


These assumptions appear to be axioms of the theory of subjective probabilities. Further, 
it is proved first that the unique probability distribution associated with the relation < and, 
second, the Kolmogorov’s probability axioms are valid for the random events, given by the 
assumptions 1-4. 

Subjective probabilities, being a numerical measure of an event likelihood, are found by 
their comparison with the events having certain probabilities. In view of this circumstance, 
we have to assume that there exists a class B of events with the following properties: 1) each 
event from the class f has a certain probability; 2) for each number p (0 < p < 1) there is 
an event B € B the probability of which is equal to p. Thus, to determine the probability 
of some event A, we need to find such an event B € B that A ~ B and to assign to A the 
same probability as that of B. As events from the class B are chosen, the events of the form 
Z €1, where X is a random variable having uniform distribution on [0,1], 7 = [a,b]. In 
particular, if J) Ch), then {X € 1} > {X € lh}. To perform such a passing, we state one 
last assumption: there exists a random variable with a uniform distribution in the interval 
(0, 1]. 

The above method of obtaining subjective probabilities was named byDe Groot [63] an 
auxiliary experiment. Clearly, it is not necessary to carry out such an experiment; more- 
over, even the existence of its establishment is redundant. It is sufficient that a statistician 
imagine an ideal experiment which determines a random variable with the uniform distri- 
bution and be able to compare the relative likelihood of the event he is interested in with 
that of an arbitrary event of the form {X € /}. 

The uniqueness of the distribution P{A }is justified by the following theorem (proved in 
[63]). 
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Theorem 1.1. For any event A there is the unique number a. (0 <a. <1) such A ~ G0.a.). 
Here G{a,b} = {X € [a.b]}. The desired probability distribution, in view of the theorem, is 


represented by the relation 
A~G([0,P{A}]. 


As follows from this relation, for any two events A and B such that A < B, GO.P{A} ~ 
G[0, P{B}], hence P{A} < P{B}. 


Another way to determine the subjective probability is based on the union of the concep- 
tions of the indeterminacy and usefulness. Ramsey initiated the solution theory which was 
based on the duality; of interconnected notions of estimating probability and usefulness. In 
accordance with this theory, the probability appears to be the degree of readiness of the ob- 
ject to perform one or another action in the situation of the decision making with unreliable 
possible gains. It is required only that all possible outcomes be of equal value. 

The work by De Finetti, devoted to the determination of subjective probabilities in the 
situation of the chance analysis in laying a bet. 1s a brilliant development of this theory. Let 
us consider, briefly, the essence of the De Finetti constructions. Suppose that we have to 
estimate the chances on the set of certain events A. B.C. ... and to take any bets from people 
who want to bet on these events. This means that each event A is associatedwith some 
probability P{A}. If now, S4 is the opponent bet (positive or negative). that is. this sum must 
be paid off in the case when the event A happens, then the cost of the bet participation ticket 
must be equal to P{A}S,. It is natural to raise a question: “What desired properties must 
be assigned for these probabilities”. De Finetti proposed to use the following coherence 
principle: the probabilities must be assigned in such a way that there is no loss in general. 


This simple principle implies immediately the fulfilment of all probability axioms. 


a) O< P{A} < 1. If the opponent bets on A and A really happens. then his prize will be S, 
less the ticket price P{A}S,, that is W; > S|} — P{A}]. If the event A doesn’t occur, then 
his prize is W) -. —SP{A}. The coherence principle requires that W)W> < 0 for all S. 
that is, [1 — P{A}|P{A} > 0or0< P{A} < 1. 

b) P{Q} = 1. Whenever an event will occur, it belongs to a sample space Q. If the 
opponent bets on Q, his prize is Wo = Sa{] — P{Q}]. Due to the coherence condition, 
there is no such Sg, that Wo > 0. Hence it follows the relation P(Q) = 1. 

c) IfANB = 6, then P{AUB} = P{A} + P{B}. Let the opponent bet on the event A. B 


and C = AUB. The following outcomes with corresponding prizes are possible: 
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for AN BW, = S4(1 — P{A}) — SgP{B} + Sc(1 — P{C}), 
for AN BW> = —SaP{A}+Sp(1— P{B})+Sc(1—P{C}), (1.4) 
for AN BW3 = —S4P{A} — SgP{B} —ScP{C}. 


The coherence condition requires the following: there are no such S4, Sg and Sc that the 
prizes W,, W2 and W3 are simultaneously positive. If the main matrix of the system of 
linear equations (1.4) is invertible, then it is possible to make the bet’s $4, Sg and Sc in 
such a way that the prizes get arbitrary preassigned values. 

In order for this not to happen, the determinant of the main matrix of the system (1.4) must 


be equal to O, that is, 


1—-P{A} —P{B} 1—P{AUB} 
=PiA )-=BB) 1 PsA Bt | —0, 
—P{A}  —P{B} —P{AUB} 


or —P{AUB}+ P{A} + P{B} = 0. 


Hence 
P{AUB}+ P{A} + P{B}. 


From the De Finetti construction we may conclude: as far as the confidence degrees (for the 
estimation of the bet chances in the subject case) are subjected to the Kolmogorov axioms 
and have a probability interpretation, they can be represented in a probability form. Limer 
[140] ascertains that there is only one answer to a question about the requirements imposed 
on the confidence levels: “They must be only probabilities and there are no other needed 
requirements. If a relative frequency is given and all events are equiprobable, then, in view 
of such a confluence of circumstances, the individual probability is found to be equal to the 
frequency.” 

The theorem on interchangeability of events is an important result of the De Finetti theory. 
First of all, De Finetti ascertains that the notion of independence, broadly used in classi- 
cal statistics, appears to be only a mathematical abstraction and cannot be related to the 
chain of events which are recognized intuitively or empirically. Instead of the notion “in- 
dependence” he introduces the notion “interchangeability”: a sequence of random events 
is called interchangeable if the corresponding (to events) probabilities are independent of 
the successive order of the events. For example, AAA and AAA have the same probabilities. 


The following important theorem is proved byDe Finetti [62]. 
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Theorem 1.2. Any coherent assignment of probabilities for the finite interchangeable se- 
quence of binomial events is equivalent to the limit assignment of these events with the help 


of the simultaneous distribution for which: 


a) if it is considered as conditional with respect to p, then the events appear to be mathe- 
matically independent and 


PAAR AALS AVS p (py: 


b) there is a unique prior distribution h(p). A marginal distribution has, in this case, the 


following form: 
. a 1 
P{AA...AA...A} =} p’(1—p)" “h(p)dp 


This theorem gives the important methodological result of the prediction of the happening 
of possible events. For example, given some true assignment of probabilities of an infinite 
sequence of interchangeable events and if the number of successes 1n the first 7 trials is r. 
then the success probability in the next trial equals 
P{A\A2A3 setae y } 

P{A\A2A3--°An 


fe rH. — py-Th(p yy - 


[. p'(1—p)" Th(p)dp 


P{An+1 |A1A2A3°-:An} = 


where 
pU=p)!" te 
/ yal — p)"Th(p)dp 


h(p) 


Thus, the probability of foreseeing the outcome of the next trial is such that as it would be 
some true part of successes p and some prior distribution fi(p) which transforms. in view 
of Bayes theorem, into the posterior distribution fi, starting from the results of independent 
sampling. 

There is a theory of subjective probabilities which concentrates on the guarantee of the 
possibility to transmitting the subjective information. It was developed in the works by Cox 
[49], Tribus [250] and was philosophically substantiated by Crellin [50]. The possibility 
of the subjective information to be transmitted and the use of likelihood for the acceptance 
of decisions are the source of this theory. The system, consisting of likelihoods, must be 


subjected to the following requirements: 
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1) The system must not be ambiguous, that is, the assertion, for which the likelihood is 
used, must be precise. 

2) The system must guarantee comparability in general. Likelihoods of different state- 
ments must have the possibility of comparison in order to transfer subjective informa- 
tion about which of the events is more probable. The system must be admissible for any 
assertion. 

3) The system must be noncontradictory, that is, if we have different ways of likelihood 
estimating, it is necessary that their results be the same. 

4) The system must possess the property of continuity of the method of likelihood estimat- 
ing. 

The first requirement is satisfied due to the use of symbol logic and logical propositions, the 

second one because of the real number range for the quantity likelihood measure. The third 

and the fourth conditions require that numerical representation of likelihood for composite 
statements be subjected to the functional relations which use the likelihoods of components. 

Reasoning intuitively one comes to the conclusion that the likelihood measure ©(-) must 


satisfy the relations 
O{ANB| C} = Of{A | C}O{B| ANC} = O{B| C}O{A | BNC}, (1.5) 
and 
@{A|C}+@{A|C} =]. (1.6) 


In the works [49, 250] the necessity of using these relations precisely for the likelihood 
measure is substantiated. They are also fundamental in probability theory. There is, how- 
ever, the principal difference in sense between the classical interpretation of probability 
and the one given by the relations (1.5) and (1.6). Crelin [SO] brings up a justified pro- 
posal that such a notion of “probability” is needed only in order to obtain the possibility of 
manipulation by the usual rules of probability theory and has a deductive form. 

We conclude here that the theories of subjective probabilities are based on Kolmogorov’s 


axioms. 


1.5 The Hierarchical Bayes Methodology 


This methodology (developed from the orthodox Bayes methodology) is the subject of 
investigation in the works by Good [93, 94]. The considered phenomenon is associated 


with different probability levels subjected to each other. The relation among these levels 
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is ensured by means of successive conditional distributions. In this case the Bayes rule is 
applied as many times as the number of levels, in addition to the initial one. are given. We 
illustrate the hierarchical Bayes approach in the following example. 

Let X follow a normal distribution with unknown mean Le and known standard deviation 
oO. that is. f(v) ~ fia) Nite). This probability level we will consider as the lowest 
or initial. According to Bayes setting we let pg - M be a random parameter. having a 
prior distribution A(u). If we use a prior distribution, and conjugate to the kernel of the 
“likelihood” function, then for A(t) we should take the normal density with parameters a 
and s, i.e., A(w) — A(uea.s.) ~~ N(a.s), With respect to the value of XY. a and »s are hyper 
parameters (Good [94], Deely. Lindley [59] and others). So. how do we choose hyper 
parameters a and s? To do this we have to go one step up in the Bayes hierarchy. that is. let 
aand s be random parameters and define their a priori distribution fy. a.s+. Then the prior 
probability density for the parameter UW can be written with the help of a mixed density. if 


we accept that /(1) is conditional density with respect to a and s: 


ieee II silts ails nero eeeS (1.7) 
(Grae 


where 92,, is the range for a and s. Then the representation tor the marginal density of X 


has the form 


faeal— | form h( gdp 
JM 


lI 


[ forwau If, RC aes Thi ca vibes (1.8) 


It seems obvious that (1.7) can be written for the posterior probability density Aike <i as 
well, if according to the Bayes theorem we add an observation vector of empirical data to 


the conditional prior density h(tt;a,s). 


1.6 Use of the Bayes methodology in reliability theory 


Can we apply the Bayes approach in the reliability theory? This question doesn’t have 
a unique answer among the specialists in this area. [fa reliability conclusion has to be 
considered as an element of the solution process, then empirical data must be added by 
subjective knowledge related to the subject. This is a direct consequence of an engineering 
practice. Construction of the new technical device involves on one hand an individual ex- 
perience, mathematical modeling and analog devices, and on the other experimental work. 


The set of factors of the first group delivers an a priori judgement about reliability, while 
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experimental work gives empirical data. Both are relevant to the process of making a deci- 
sion about reliability. Indeed, if we can use our experience while working on a device, why 
can’t we rely on that experience when estimating the quality of the device? 

Many scientists and specialists indicate the usefulness of Bayes methodology in reliability 


theory (see [14], [30], [43]). It will be discussed extensively throughout the development 
of this book. 


Chapter 2 


The Accepted Bayes Method of Estimation 


2.1 The components of the Bayes approach 


We give a brief description of the structure of Bayes estimates with the help of formal 
mathematical constructions of the Bayes theory. The Bayes scheme of the decision theory 


includes the following four components. 


1) The statistical model, represented by the probability space (Q,.%,P). Here Q is 
the set of all possible data in some design of experiments IT, Q = {x}. The data x appear 
to be the data of a random experiment, thus on Q it is determined some o-algebra Y% of 
random events; P € &, where Z is the family of probability measures on Q, &. In the 
traditional Bayes approach, the probability measure P is defined by the representation of 
some parameter 6 (vector or scalar), that is, A = { Pg; 8 € O} is a parameterized family of 


probability measures. 


2) The probability space (©,¢,H) for the parameter 6 which is assumed to be ran- 
dom. Here & is o-algebra on ©, H is a probability measure on (©,¢). The measure H 
is called a prior probability measure of the parameter 8. The prior measure H belongs to 


some given family of probability measures 7. 


3) The set of such possible decisions D that each element d from D is a measurable 
function on Q. In estimation theory the set of decisions D may contain all estimates of the 


parameter 8 or some function R(@) measurable on Q. 


4) The loss functions L(6,d) (or L(R(@),d)) determined on © x D. This loss function 
determines the losses caused by an erroneous estimation, that is, by the replacement of the 
parameter 6 by the decision element d. It is assumed later that the families 4 and .# are 


dominated by some G-finite measures tt and ¢ respectively. If we denote the densities 
F(x| 0) = Po{dx}/u{dx}, h(@)=H{d6}/¢ {d}, 


17 
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which exist in a view of the Radon-Nikodym theorem, the joint density of the probability 


distribution for the random variables X and @ takes on the form 


8(x,0) = f(x| @)h(@). 


In accordance with the Bayes theorem, the conditional density for @ given X = x is called 


the posterior probability density function (p.d.f.) of the parameter @ and is written as 
F(x | 8)A(8) 


n(@|X =x)= 
[re oy {a0} 


VEO, (2.0) 


for each x € Q such that 


(x)= / F(x} @)h(@)C{d0} > 0. 


If Y is a statistic on (Q.,.&, Pg), then the probability measure Pg can be obtained by trans- 
formation into P}. If f’ (y | 8) = Pj {dy}/u{dy} is the density of the probability measure 
ea then the posterior p.d.f. of the parameter 6 given Y(X) = x has the form 


fT (y| @)h(9) 


(6 \¥ =) = 
Lf 9h O15 {dG} 


(22) 
Further, for the sake of simplicity, we will use for the prior and posterior p.d.f. appearing 
in the Bayes formulas (2.1) and (2.2) the notations /(@) and h(@ x), respectively. Since 
the denominator in (2.1) and (2.2) is independent of @ and is determined only by the obser- 
vation x (or by the statistic y), we will determine only the kernel of the prior density using 


the symbol of proportionality “~". So, instead of the expression (2.1), we will write 
A(O | x) f(x| @)A(@) (2.3) 


taking into account the fact that the normalizing factor of the p.d.f.. i(@ x) has been found 


from the integral 


“4 
B= | [relomestaey| (2.4) 


In the case when the parameter @ takes on the discrete values 6). > 


oad 6. the prior dis- 
tribution is given in the form of prior probabilities p, = P{@ = O;}. 7 = 1..... k Tie 
expressions (2.3) and (2.4) are also valid for this case. if one represents (6) and h(@) by 


means of a delta-function. In particular, 


k 
h(@) = )° pj5(@ — 6)). 
Bs 
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The Bayes formula (2.3) lets us find the posterior density of the parameter @ in the form 
k 
n(0 |x) =) pj5(0 -6)). 
=! 


where p; = P{@ = 0; | x}, j= 1,...,k, are the posterior probabilities. 

For the discrete values of the parameter 0, the Bayes formula is often written in the form 
Pjf(x| )) 

Lier Pif (x| 4) 


The choice of a loss function plays an important role in the theory of Bayes estimating. In 


pj= (SSB eree!'s (2.5) 
most cases the loss function is represented in the following form: 
L(6,d) =C(8)W(|d —6)), (2.6) 


where W(0) = 0, and W(r) is a monotonically increasing function for t > 0; C(@) is as- 
sumed to be positive and finite. The prior Bayes estimate 6 is defined as an element from 


D which minimizes the prior risk [272] 


G(H.d) =f fl yaar} [ c(8) W(|d(x) — 6|)H{d6 | x}C(0)W( 


After the X has been observed, the most handy function (from the Bayes point-of-view) for 


Ot) 


further consideration is not the prior risk (2.7) but the posterior one, having the form 
G(H,d) = fe aC ~ 6|)H{d0 | X}. (2.8) 


The Bayes estimate of the parameter @ with respect to the prior distribution H should be 


the element 6;;(X ) of the set D, minimizing the posterior risk with given X: 
[cow (dpa) ennai x)= int [| c(@yw -O|)H{d@|X}. (2.9) 


The analysis of the problem in the above-given setting shows that investigation of the spe- 


cific solution with the given testing scheme is based on the following three questions: 


1) achoice of the family of probability measures &; 
2) achoice of the prior distribution H; 
3) achoice of the loss function L(d, @). 


The first question, having a practical significance, 1s associated with completeness of the 
statistical model, used by the researcher. The other two are less specific. Some recommen- 
dations on a choice of H and L(d,@) will be given below. 

In applied statistical analysis, the interval estimates are frequently used. The Bayes theory 


operates with an analogous notion having, however, interpretation which differs from the 
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classical one. In the simplest case of a scalar parameter 6. a Bayes confidence interval @ is 


introduced by the expression 


ic | x)dO= y, 
Jo 


where y is the confidence probability. Since the choice of @ can be established in many 
ways, one adds an additional requirement: the interval @ must have the minimal length. 


In the case of a vector parameter 6, the confidence interval 1s chosen from the condition 


ih _n(@ |x)d0 = ¥: 
R<R(O)<R 


moreover, the difference R — R must be the smallest. As seen from the definition above. the 
classical and the Bayes confidence intervals have different interpretations. In the classical 
form, the confidence interval, “covering” with a given probability an unknown parameter. 
is random. In the Bayes approach the parameter is random, while the contidence interval 


has fixed limits, defined by the prior density and confidence probability y. 


2.2 Classical properties in reference to Bayes estimates 


According to classical statistics the quality of statistical estimates may be characterized 
by: how much these estimates satisfy the requirements of consistency. unbiasedness, effec- 
liveness and sufficiency. As a rule. a classical estimate, approved in each particular case. 
appears to be a compromise, that is, we give preference to some property to the detriment 
of the others. As was mentioned, the leading property of the Bayes estimate is its optimal- 
ity. The classical properties, indicated above, are not adequate to the Bayes methodology. 
Many authors use them only to keep up the tradition, Here we present some results which 


modify the classical estimates in the Bayes approach. 


2.2.1 Sufficiency 


The property of sufficiency works smoothly. The Bayes formula (2.1) (or (2.2)) is con- 
nected with the Bayes definition of the sufficient statistics. A posterior p.d.t. of the param- 
cter 0, generated by the sufficient statistics S(X), is equivalent (from the Bayes point-of- 
view) to the posterior p.d.f. of the parameter 8, constructed on the initial observation, that 


1S: 


h'(8 | S(X)) = A(@ | X). 


The Accepted Bayes Method of Estimation 21 


At the same time, this proves the equivalence of the Bayes and traditional definitions of 
sufficiency (see, e.g., [272]). Thus, the property of sufficiency in the Bayes estimating 
theory keeps its classical form. 


2.2.2 Consistency 


With respect to the property of consistency we cannot draw the previous conclusion. Rea- 
soning rigorously, we can ascertain that a traditional analysis of an estimate behavior with 
the sample size tending to infinity contradicts the essence of the Bayes approach. Indeed, 
if it is assumed that 6 is a random parameter with nondegenerating prior p.d.f., h(@), then 
it is senseless to investigate the asymptotical properties of convergence of the estimate 6 
with respect to @ = 0. By the same reason, it is incorrect when computing the mean value, 
to compare it with the random variable 8. There are, however, representations that make 
possible the investigation of the estimate 64, for large samples. If we assume that a chosen 
prior distribution is not exact, then one can get the estimate with the help of the Bayes 
scheme, and, later on, investigate it, digressing from the method used in obtaining the esti- 
mate (bearing in mind classical theory). In many cases the Bayes estimates are consistent 
and converge frequently to the maximum likelihood estimate, MLE. 

Zacks [272] provides an example when the estimate of the Poisson cumulative distribution 
function p(i| A) = e~*A‘/i! with the prior A ~T(1,1) (gamma p.d.f.) is consistent. Lind- 
ley [146] proves that, if 6, is the best normal asymptotical estimate, then one can ascertain 
that Bayesian estimates and MLE are equivalent. The exact form of the prior distribution 
in this case is not significant, since for the samples with a large size MLE can be replaced 
with the unknown parameter 6. Bickel and Yahow present [24] the strict proof for the as- 
sertion, analogous to the case of the one-parametric exponential family and a loss function 
having a quadratic form. Asymptotical properties of the Bayes estimators for the discrete 
cumulative distribution functions were investigated by Freedman [87]. 

We give the part of Jeffrey’s’ reasoning’s [115] with respect to the properties of the posterior 
p.d.f. for large-size samples. For a scalar parameter @, and in accordance with (2.3), let 
p.d.f. 

h( | x) ~ h() £(0 | x) = hye), (2.10) 
where ¢(@ | x) is the likelihood function, being, by essence, a p.d.f. of the observed values 
xX = (x},X2,...,Xn) Of a trial and coinciding with f(x | @). 

(The parameter 6 is assumed to be an argument of a likelihood function.) It is supposed that 


h(@) and f(x | @) (8 € ©) are nondegenerating and have continuous derivatives; moreover, 
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¢(x | @) has a unique maximum at the point 6,,;, which is the MLE. generally speaking. 
In{@(@ | x)} has the order n, and h(@) is independent on the sample size. Thus. it is intuitively 
clear that for the large-size samples, the likelihood cofactor is dominating in the posterior 
p.d.f. 

Bernstein [169] and Mizes [166] prove the more general statement. The main thrust of 
this theorem ts that, if the prior p.d.f. of the parameter @ is continuous, then, while the 
number of observations is increasing, the posterior p.d.f. is tending to a limit (which can be 
found analytically) independent of the prior distribution. Furthermore, since under the more 
common conditions, the p.d.f. form approaches, with a growth of n, the normal distribution 
curve centered on the MLE and the posterior p.d.f. for the case of the large-size samples 
appears to be normal also with the mean value Bian: 

The proof of the asymptotical normality of the posterior p.d.f.. i(@ x). can be carried out 
as follows. Let us expand into a Taylor series the functions (8) and /i@ x) and at the 
MLE 61: 


2 : , I 5 : 
h(8) = h( ma.) + (8 — Omn1.)A'(Om..) + 5 (8 — Bm.) (mn1.) + 


(0 —6mni)h (Oma) , 1 (0 =Omi)2h" (Bn) | 
a eee ee eee 


1+ - = < 
h(n.) 2 h( Om.) 


= h(6mn1.) 


=| 


Denoting by g(@) = In/(@ | x) and taking into account the relation ¢’( A.) } = 0. we obtain 


a 


explg(8)] exp 500 - dn)?" (Bn) x [ + 4(0— Gy) ?¢"(Bm.) + / | 


where the last equation is obtained by the expansion e* = 1+x+---. 


Multiplication of these expansions gives us 


w(@ | 3) exp | (0 — Bn )Pe"(Bm) 


(@ a Bint JA! (Onn 1 ) | (0 — Os, 2" On | ) | fe en 
| Pee : 6 zine 
h(8m.1.) 2 h( m1.) we 6 | mi.) 8 (Om.i.) 


(291) 
The dominating factor has the form of a normal p.d.f. with the mean value equal to MLE 


an 


6,1, and the variance 


oma yet _ [22m 1x9) 
[-3"(@mi.)]} = ae 8=6m,1 


Thus, if we use only the dominating cofactor, the approximation of the posterior p.d.f. of 


6 for large sizes of the sample n takes the form 


Le te 1 | n ee 
M812) = Teele" Bns)Pex|—5(0 Bon )1e"(@ns)l] 12 
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Since 1e”"(Om.1.)| usually is a function of n, then with the growth of n, the posterior p.d_f. 
takes on the more pointed form. Jeffrey’s [115] points out the fact that this approximation 
gives errors of order n '/2, Koks and Hinkly [125] generalize these results to the case of a 
vector parameter 6. 

To justify (2.12), one may only use the fact that the likelihood must concentrate with in- 
creasing order about its maximum. Hence, these conclusions can be used more broadly 
than the case of independent random variables with the same distributions. Dawid [54] and 
Walker [262] carry out a scrupulous investigation of a set of regularity conditions under 
which the posterior distribution with the probability equal to unity is asymptotically nor- 
mal. These conditions are almost alike as regularity conditions which are necessary for the 
asymptotic normality of the MLE. The research on the application of the expansion (2.11) 
for statistical outcomes may be found in works by Lindley [143] and Johnson [117]. 

The relation between the consistency of Bayes estimates and MLE is studied in the work 
by Strasser [242]. The point is that there is an example by Schwartz [231] in which the 
MLE is nonconsistent, but the Bayes estimate, under the same conditions, possesses the 
property of consistency. Strasser [242] complemented the regularity conditions up to the 
strict consistency of the MLE [272] by the conditions for the prior measure H so that 
the consistency of the maximal likelihood estimator implies the consistency of a Bayes 
estimator. The investigation of the relations between the consistency of a Bayes estimator 
and MLE is carried on by Le Cam [136]. 

If it is assumed that the parameter @ is fixed but unknown, then the consistency of a 
Bayes estimator can be investigated more naturally and nearer to the classical interpre- 
tation. These questions are considered by De Groot [63], Berk [19], Mizes [166] and by 
other authors. They may be interpreted as follows: if x), x2,..-,%, is a sample from the dis- 
tribution with the unknown parameter @ and if the value of @ is actually equal to 4, then, 
as n —> 0, h(@ | x) will concentrate more strongly about the value 6. The estimate of the 
parameter constructed on such a posterior distribution may be named, to all appearances, 
as consistent. 

We give a brief explanation for this phenomenon. Let the parameter 6 take only the finite 
set of values 0, @2,..., 0. Suppose that P{@ = 0;} = p; for i= 1, 2,..., k, and for each 
given value @ = 6;, the random variables x; , x2, ....X, generate a sample from the distribu- 
tion with the p.d.f., f;. It is assumed also that all fj are different in such a sense that, if Q is 


a sample space corresponding to the single observation, then 


[\fie)- flan) >0, ViA i 


24 Bayesian Theory and Methods with Applications 


Let, for the observed values x). .x2,....%y,. , denote the posterior probability of the event 
6 = 6; for which, due to the Bayes theorem, we have 
Pi IT file) 
pi = ————_, i= 1,2,...,k. 
y Pr IT fr(x;) 
Ui ee 


Suppose now that x1, .x2,....%, is the sample from the distribution with the p.d.f.. f,, where f 
is some of the values 1, 2,...,k. As was shown in [63], the following limit relations are 
valid with the probability equal to one: 
lim p(x) =1, lim pi(x)=0, ViAr. 

We give another example with a continuous distribution of the parameter @ which will 
be a mean value of the Gaussian random variable with a given measure of exactness r 
(the variance is equal to r~7). Suppose that a prior distribution @ is Gaussian with a mean 
value tt and exactness measure tT (—% < [U < ©, T > OQ). It is easy to check that the posterior 


distribution @ is Gaussian with the mean value 


TuU+nr le 
= ois where i — ee, 
T+ nr na 
with the exactness measure T + nr. Let us rewrite the expression for L’ in the form 
i tH fi nr 
tar" tr 


Assume now that the sample x), 12,....X, 15 factually taken from the Gaussian distribution 
with the mean value 6. In accordance with the law of large numbers (see. for example, 
Kolmogorov’s second theorem [208]), 2 = @ with the probability 1. At the same time. 
it follows from the formula for uw’, wo — ft as n+ oo. In this sense. pf’ is consistent. 
Furthermore, since the posterior variance of the parameter @ tends to zero. the posterior 


distribution of 6 converges to the degenerated distribution, concentrated at the point @. 


2.2.3 Unbiasedness 


Here, evidently, we mect a situation analogous to those in the above investigation of con- 
sistency. Since the parameter @ appears to be random, it is absurd to attempt to find the 
estimate @ in the form E(6|. Due to this circumstance, many authors, including Fergu- 
son [80], proceed in the following way: at first they obtain the Bayes estimate in some 
definite form, thereafter they “forget” about the parameter randomness and investigate un- 
biasedness in the usual interpretation of this term. 

Sage and Melsa attempt to give the Bayes definition of unbiasedness. In particular, they 


give two definitions: 
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1) a Bayes estimate 6(x) is called unbiased, if 
E[6] = E[@(x)]; and 
2) a Bayes estimate 6(x) is called conditionally unbiased, if 


E(6(x) | 6] = E[@}. 


The second definition is more essential, since, in the first place, it is closer (by sense) to 
the classical one, and in the second place, is clearer than the first definition. Since E[6] is a 
mean value with respect to the prior measure, the equality E{@(x)| = E[@] corresponds to 
that ideal scheme when the posterior distribution coincides with the prior one (it is, how- 
ever, not necessary). According to this, the Bayes estimate cannot be unbiased. Bland [25] 
gives the example of the statistical model which proves the incorrectness of the first defini- 
tion. 

The second definition of unbiasedness, mentioned above, is used by Hartigan in his work 
[102]. The estimate 6(x), obeying the condition E[6(x) | @] = E[@]. 

The possibility of using the first definition is not even discussed. Moreover, he in- 
troduces the definition of the exact Bayes estimate which must satisfy the condition 


P{6(x) # 0} = 0. Hartigan proves that an unbiased Bayes estimator is exact. 


2.2.4 Effectiveness 


We say that one Bayes estimate is more effective than the other bearing in mind the follow- 
ing reason. If the posterior probability is chosen as a measure of effectiveness, its value, for 
identical observations, will be defined by the prior distribution (on the whole by the prior 
variance of the parameter). Consequently, the comparison criterion is not objective, since 
the prior distribution may be chosen, in some sense, arbitrarily. If we use the same prior 
distribution, then in view of the uniqueness of the Bayes solution, there are no two Bayes 


estimates for the same observation. 


2.3. Forms of loss functions 


As was mentioned in § 2.1, the loss function L(d,@), where usually d = 6, is frequently 
represented in the form 

L(d,6) =C(@)W(|d —6}). (2.13) 
Here W(0) = 0 and W(r) is a monotonically increasing function; C(@) is assumed to be 


positive and finite. As mentioned by Le Cam [136], the loss function of the form (2.13) was 
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proposed by Laplace who understood that the exact expression for the function W cannot 
be found analytically. 

The choice of the loss function is an important question in the theory of Bayes statistical 
estimating. Accuracy of such a choice stipulates the estimate quality. Frequently authors 
use a squared-error loss function, for which W(|d - 6)) — (6 — di. This function gives 
a good approximation for any loss function of the form C(@)W( d—@ ) having a smooth 
character in the neighborhood of the origin. Another function which is the convex loss 
function satisfying the condition W(|d — @|) = (d—@)‘, k > 1. 

It is well known that the Bayes estimator of the function R(@) for the squared-error loss 


function has a form of the posterior mean value 
pe i R(8)h(@ | x)d0. 
fc) 


For k = 1, the median of the posterior distribution appears to be the Bayes estimator. The 
theory of Bayes estimating for convex loss functions was developed by De Groot and 
Rao [64]. Rukhin {214] proves a theorem for which the estimate of the parameter @ 1s the 
same for any convex loss function, if only the posterior density is unimodal and symmetric 
with respect to 0. The loss functions represented above are unbounded. This circumstance 
may be a reason for misunderstanding. In particular, Girshik and Savidge [88] give an 
example in which the Bayes estimate, minimizing the posterior risk. has an infinite prior 
risk. 

In a number of works there are also other loss functions whose properties are connected 
with the properties of the statistical models and peculiarities of the phenomena investigated 
by researchers. The direct generalization of the squared-error loss function will be the 
relative squared-error loss function given by: 

6-98 


Ls, (6,0) = ae (2.14) 


and its modification 


g8 — 6B 


LggiGnove=| —e 


pero. (2.15) 
Which are broadly used when the investigations are directed precisely toward the relative 
errors. As shown by Higgins and Tsokos [108], the Bayes estimator of R(@) under some 


loss function, minimizing the posterior risk with the loss function (2.15), is computed in 
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the following manner: 


A(O|x) 71/8 
hiner 
(6 |x) 
0 [R(O)78 


Harris [99] proposes to use for the investigation of probability of a nonrenewal system 


Ra = 


being operated without breakdowns with a loss function given by: 


k 
: (2.16) 


n 1 1 
i, | Lnneeeee = a 


Thereafter he states: “If the reliability of a system is 0.99, then it fails, in the average, only 


once in 100 trials; if, at that time the system reliability is 0.999, then it fails only once in 
1,000 trials, that is, this is ten times better. Therefore, the loss function must depend on 
how well we can estimate the quantity (1 — @)~!.” 

Higgins and Tsokos [108] propose to use the loss function of the form 


fi e—f2(6-6) digs efi(8-8) ¢, Te 


L.(6, 0) = Rj ; 


fi>9, f2>0, (2.17) 


which enforces the losses, if the estimate is substantially different from the parameter. It is 


interesting that for small 6 — 6, 
t 
L.(6,0) = DS (g — 6)? +0((6 —6)?). 


The authors compare Bayes estimator of probability of failures, the mean time prior to 
failures with the reliability function for squared-error loss function with those having the 


form (2.15), (2.16), (2.17), and a linear loss function of the following form: 


p|e — 6), 6<8, 


Be B (2.18) 
(1—p)|@-6|, @>8, 


BAG 0) = 
Which generalizes the function L(6,0) = |@— 6| mentioned above on the case for un- 
equal significance for exceeding and underestimating of the estimate 6 with respect to the 


parameter 6. The conclusions given by Tsokos and Higgins may be interpreted as follows: 


1) The quadratic loss function is less stable in comparison with the others we have con- 
sidered. If the quadratic loss function is used for approximating, then the obtained 
approximation of the Bayes estimate is unsatisfactory. 

2) The Bayes estimator is very sensitive with respect to the choice of loss function. 

3) The choice of loss function should be based, not on the mathematical conveniences, but 


on the practical significance. 
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The loss function which uses the fact that exceeding the parameter is worse than decreasing 


(this is intrinsic, for example, for the reliability measure) is written by Cornfield [47] in the 


form 
6 2 
BN al 6-86 
L(6, 0) = ‘ ; , (2.19) 
7) (4) : 
Kj a sak i. . 6 e: 


In order to ensure for the loss function the different significance for the positive and nega- 


tive errors, Zelner [274] introduces the so called linearly-exponential loss function 
Lex (6 — 6) = b [e%-®) — a(6 — 8) — 1 (2.20) 


This function is asymmetric and is nearly symmetric for small @ and can be well approxi- 
mated by the quadratic functions. We give an example of the estimator which is obtained 
from the loss function (2.20). If X is a Gaussian random variable with the given mean 
value @ and given variance o°, and the prior distribution density @ satisties the condi- 


tion h(@) ~ const., then 


where x is a Sample mean value. It is not difficult to verify that for small @ and/or for large 
sample sizes n, the estimator 6” is near the MLE. The loss function 12.20) solves actually 
almost the same problem as that in (2.19). But the last loss function is not so handy in 
calculations because we cannot find with it the desired estimates in close analytical form: 
instead we have to use special numerical methods to obtain the desired approximation. 

El-Sayyad [73] uses, in addition to the loss functions given above. the following loss func- 


tion: 
Lap(6,0) = 0% (6° — @F)?, (2.21) 
and 


Lin(8, 0) = (In 6 — In@)?, (2.22) 


Smith [235] determines the class of bounded loss functions A given by the conditions: the 
loss unction is symmetric with respect to |@ — 8). decreases with respect to |6 — 6! and 
satisfies the conditions 


supL(6,0)=1, infL(6,0) =0. 
6.8 6.6 
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Smith scrupulously investigates the Bayes estimates of the so-called step loss function 


0 if |6-0| <b, 


; (2.23) 
1 if |6—@|>5, 


14(0,0) = La(6 — 8) = 


Estimators were found for many parametric families. These estimators differ substantially 


from the Bayes estimators with the squared-error loss function. 


2.4 The choice of a prior distribution 


The choice of prior distribution in applied problems of Bayes estimating is one of the 
most important questions. At the same time, the solution of this problem doesn’t touch 
the essence of the Bayes approach. The existence of a prior distribution is postulated. All 
further arguments are based on this postulation. Some authors, however, investigate the 
question of choice of a prior distribution being in the framework of the Bayes approach. 
We propose the following three recommendations for the choice of a prior distribution. 
They are, correspondingly, based on: 1) the conjugacy principle; 2) the absence of in- 
formation; and 3) the information criterion. We shall discuss individually each of these 


recommendations. 


2.4.1 Conjugated prior distributions 


Each prior distribution, due to the Bayes theorem, can be used together with any likelihood 
function. It is convenient, however, to choose a prior distribution of a special form giving 
the simple estimators. For a given distribution f(x | 8) we may find such families of prior 
p.d.f. that a posterior p.d.f. will be the elements of the same family. Such a family is 
called closed with respect to the choice or conjugated with respect to f(x | @). It is said 
sometimes: “‘naturally-conjugated family of prior distributions”. Most of the authors state 
that this approach is dictated by the convenience of theoretical arguments and practical 
conclusions. Haifa and Shleifer [202] attempt to give a more convincing justification of a 
conjugated prior distribution. We discuss this question in detail. 

Assume that sample distributions are independent and allowing the sufficient statistics y of 
fixed dimension with the domain Q,. A family # of all prior distributions is constructed 
in the following way: each element .” is associated with the element Q,. If, prior to a 
trial, for @ is chosen the element from .# corresponding to y’ € Q, and a sample gives 
the sufficient statistics y, then the posterior distribution also belongs to “# and assigns 


to some element y” € Q,. For the definition of y” with the help of y and y’ a binary 
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operation y” = y’ *y is introduced. We consider below the formalization of a conjugated 
prior distribution given in [202]. 
It is supposed that for arbitrary samples x = (x).x2...... x,) with each fixed n there is a 


sufficient statistic 


Vn =e in) Sy Oe 


where yj; is a real number and the dimension of the vector y is independent of 7. 
For any given n and arbitrary sample (x1,x2....,- x,), there exists a function k and s- 
dimensional vector y = (¥),y2...-,¥s) consisting of real numbers, that the likelihood func- 


lion satisfies the relation 
£00 lxiatoee see) me k(é | y): 
The function k(@ | y) is called a likelihood kernel. We will touch upon an important prop- 


erty of the kernel k(@ | y). 


Theorem 2.1. Lety') = yp(x1,42..--5. Xe) ATG an t,,). Then we can find 


such a binary operation * that satisfies the relation 


and possesses the following properties: 

fa 0 | exacoaiags: «38 in) k( Oly"). 
and 

k(8 |y*) —k(8 | y™) k(0 | y). 


As it follows from the theorem, y* can be found only by using v''’ and y ? . without 
Gace meer & 
The posterior p.d.f., ts constructed with the help of the kernel function &(@ | ¥) in the 


following way: 


h(@|y) = N(y)k(4 |y), (2.24) 


where y is some statistic, V(y) is a function which needs to be defined. 

In order for the function h(@ | y), detined on © by the relation (2.24), to be a p.d-f., it 
is necessary and sufficient that this function be nonnegative everywhere, and the integral 
from this function over © will be equal to unity. Since k(@ | y) is a kernel function of a 


joint p.d.f. of observations, defined on © for all y € Qy, is necessarily nonnegative for all 
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(y, 6) from Q, x ©. Consequently, if there exists the integral of k(@ | y) over @, then N(y) 
is determined by the relation 


imi"! = [ x8 | yao 
and h(@ | y), represented by the expression (2.24), will be a p.d.f. 
Suppose now that y is a sufficient statistic, determined with the help of the observed sample 
(x1 ,42,-..,%n), and A(@) is a prior p.d.f. In accordance with the Bayes theorem for the 


posterior distribution density we have 
h(Oy) ~ h(8)k(@ | y) 


If now h(@) is a p.d.f., conjugated to the kernel k with the parameter y’ € Qy, that is, 
h(@) ~k(@ | y’), then, in accordance with the Bayes theorem, 
h(8 |y) ~k(8 | y')k(8 | y) ~k(8 | y’ *y). 

Thus: |) the kernel of a prior p.d.f. is combined with the kernel of a sample in a manner 
similar to the combination of two sample kernels; 2) both a prior and posterior p.d.f. are 
induced by the same likelihood kernel, but their generating statistics are different. These 
conclusions may be interpreted as a follows: the prior distribution is a result of processing 
some nonexistent data (or data which exist but are lost) for the same statistical model as a 
likelihood function. 

Let us consider the following example. A Bernoulli process with the parameter @ = 
p induces independent random variables (x;,x2,...,X,) with the same probabilities 
p*(1—p)! *, where x = 0,1. If n is the number of observed values and r = )x;, then 


the likelihood of a sample is written as 


Cn P| X1,X2;-+.,An) op (l—p) 


In addition to this, y = (y),y2) = (74n) is a sufficient statistic whose dimension is equal 
to 2, independently of n. A prior p.d.f. conjugated with the likelihood kernel and induced 
by the statistics y’ = (7’,n’) is a density of the beta distribution 


p’(1—p)""" 


lhe Ea O<p<l, 
where 
i 
B(a,p) = fx" —aP tar = we 


In view of the Bayes theorem 


n(p ly) h(p)p’(1— py" > pel = pyr), 
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that is, the kernels of the prior and posterior p.d.f. coincide, and the beta distribution with 
the parameters 7’ = r+’ and n” =n-+n’ appears to also be posterior. 

A family of conjugated posterior d.d. may be enlarged by the extension of the domain Q, 
up to and including all values for which k(@ | y) is nonnegative for all 6. and the integral 
of k(@ | y) over the domain © is convergent. 

In the example we have considered, the parameters r and n take the values of positive 
integers. At the same time, an integral of k(@ y) over O'0. 1) converges for all real r > - 1 
and n > —1 to the complete beta function. Therefore. we can obtain. assuming that the 
parameter y — (7.1) may take an arbitrary value from the domain determined in such a 
way, the family of densities which is substantially broader. 

A complicated report on naturally conjugated p.d.f. is given in the monographs [91] 
and {202}. Dawid and Guttman [55] investigate the question of obtaining conjugated dis- 
tribution in foreshortening of singularities of models. In particular, it is Shown that simple 


forms of conjugated distributions are an implication of a group structure of models. 


2.4.2 Jeffrey’s introduces prior distributions representing a “‘scantiness of knowl- 
edge” 

These distributions are the subject of consideration in the work by Zelner [272] and also are 

investigated by other authors. This assumption is an implication of the desire not to leave 

the Bayes approach in the cases when an investigator doesn't have enough knowledge about 

the properties of the model parameters or knows nothing at all. Jeffrey's [115] proposes 

two rules for the choice of a prior distribution, which, in his opinion. “embrace the most 


widespread situations”, when we don’t have the information on the parameter: 


1) if the parameter exists in the finite segment [a,b] or in the interval ( —cc. +99) then its 


prior probability should be supposed to be uniformly distributed; 


NO 


if the parameter takes the value inthe interval {Q. co), then the probability of its logarithm 


should be supposed to be uniformly distributed. 


Consider the first rule. If the parameter interval is finite. then for obtaining the posterior 
distribution we may use the standard Bayes procedure. 

In so doing, a prior distribution is not conjugated with the kernel of a likelihood function. 
If the interval for the parameter @ is infinite, we deal with improper prior p.d.f. The rule 


of Jeffrey’s for the representation of the fact of ignorance of the parameter value should be 
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interpreted in this case as 
h(@)d@“~d0@, -w~<@<~, (225) 


that is, h(@) “const. Thus, we have 


‘i . h(@)d0@ = ©, 
Jeffrey’s proposes to use for the representation of a probability of a certain event instead 
of 1. Exactly this fact, in his opinion, allows us to obtain a formal representation of igno- 
rance. For any two intervals (a,b) and (c,d) the relation 

Pia< 0 <p}. 0 

P{c<@<d} 0’ 
that is, represents indeterminacy, and thus we cannot make a statement about the chances 
of 8 being in some finite pair of finite intervals. 
The second rule of Jeffrey’s touches upon the parameters whose nature lets us make an 
assumption on their having a value lying in the interval [0,cc) for example, a standard 
deviation. He proposes for such a parameter its logarithm having a uniform distribution, 


that is, if one puts 0 = log 6, then the prior d.d. for @ will be chosen in the form 
h(d)dbudB¥, —-~< P<, (2.26) 
Since d3 = d0/6 (2.26) yields 
h(0)r07', 0<O<~. (2.27) 
corresponding to the absence of information about the parameter 6. 


An important property of (2.27) is its invariance with respect to the transformations K = 0”. 


Actually, 
dK =n@""'d0e => —u—. 


This property is very important because some research parameterizes the models in terms 
of the standard deviation o, others in terms of a variance 6? or in terms of the parameter 
of exactness T = 07. It is easy to show that, if we choose the quantity do/o as the prior 
d.d. for o, the relation will be 
do do dt 
ico  4oe) ae 


4 


a logical implication. This prior distribution is also improper, whence we may conclude 
that the relation P{0 < @ < a}/P{a < @ < ©} is indeterminacy, that is, we can say nothing 
about the chances of the parameter being in the intervals (0,a) and (a,°°). Indeterminacy 


similar to this one is considered again a formal representation of ignorance. 
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A question of representation of an improper prior p.d.f. is considered by Akaike [2-4]. He 
proposes the following interpretation: an improper prior p.d.f. can be represented in the 
form of a limit of a proper prior p.d.f. in such a way that the corresponding posterior p.d.f. 
converges point wisely to the posterior p.d.f., responding to an improper prior distribution, 
A mutual entropy is considered their nearness measure. It 1s shown also that the most 
appropriate choice is a choice of approximating eigenvalues, depending on a sample. 

In spite of the fact that prior p.d.f.s, in accordance with the assumption of Jeffrey's are im- 
proper, corresponding to them the posterior distributions are proper and allow us to obtain 
the desired estimates. Let (x), .x2,.....%,) be a sample from N(u.o) where pp and © are 
unknown. If we have no prior information about “ and 6 we may apply the principles of 


Jeffrey’s and use as a prior d.d. a function of the form 
! 
h(u,o)dudou 5 duds, —wo<c U<o, O<O<~, 
Using the Bayes theorem, we can easily obtain the posterior d.d. That is, 


A(u,o |x) ~h(p,o) (UL, o | x) 


ieee Le , 
ora OP — 552 Lvs +n(u— ft) >, (2.28) 


a) ' 


wheren!(uxo | xo" exp [ — V(x, - pW) /(207)| is a likelihood function. 1 — n= 1. 
= Le vs? = ¥(a; — f1)*. The posterior density we have written is proper. In the same 


manner, a marginal posterior d.d. of the parameter 


n(u|x) = [ n(u.0|2)d0 


om, ie 42] 
- | Grei oXP 4 — 55 [vs +n(p—p)*| edo 


9 eel 
2 


o [vs? + n(n — py] > (2.29) 


is proper. As seen from (2.29), A(u |x) has a form of Student d.d. with a mean value fi. 


] vs? 
h(a |x)u Svat CXP (-#5) : 


This posterior d.d. for o has a form of the inverse gamma-distribution. 


Analogously to fi(o | x), 


Some authors decide not to use improper d.d.. preferring instead to introduce “locally- 
uniform” and “sloping” distribution densities. Box and Tico [28] propose the functions 
which are “sufficiently-sloping™ in that domain where a likelihood function takes greater 


values. Outside of this domain, the form of the curve of a prior p.d.f. doesn’t matter, 
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since, if one finds a kernel of the posterior p.d.f., he multiplies it by the small values of a 
likelihood function. 

The most interesting and important peculiarity of the proposed improper prior p.d.f. is 
the property of invariance. Jeffrey’s gives it an interesting interpretation. He proves the 
following statement. Suppose that a prior p.d.f. for the vector @ is chosen in the form 


1/2 


h(O) ~ |Infg| (2.30) 
Here Infg is a Fisher information matrix for the vector of parameters @ = (0, 0,..., 9x). 
that is, 
0? log f (X | @) 
Infg = —Ex | —————_— 
— | 06,06; | . 


where the mean value is taken over the random variable X. Then a prior p.d.f. of the form 
(2.30) will be invariant in the following sense. If a researcher parameterizes his model 
with the help of the component of the vector 7, where 7 = F(@), and F is single-valued 
differentiable transformation of the components of the vector 8, and chooses a prior p.d.f. 


for @ so that 
h(n) & |Inf, |'/. 


then the posterior probability statements, obtained in this way, don’t contradict the posterior 
statements obtained with the help of parameterization of the components of the vector @ 
and a prior p.d.f. of the form (2.30). The proof of this statement can be found in the book 
by Zelner [275]. Hartigan [101] develops the idea of representing a prior p.d.f. in the form 
(2.30) and formulates six properties of invariance. The property (2.30) is a particular case 
among them. Hardigan’s interpretation of invariance is more common and includes the 
invariance relative to transformations of a sample space, repeated performance of samples, 


and contraction of a space for the parameter @. 


2.4.3. Choice of a prior distribution with the help of information criteria 


This is the subject of investigation in many works devoted to the Bayes estimation. In this 
connection, [46, 60, 65, 108, 275] should be distinguished. 

The approach proposed by Zelner [275] may be interpreted as follows. As information 
measure, contained in the p.d.f. of the observation f(x | @) for a given @, is used in the 


integral 


1,(0) = fre 8) Inf(x| 6) dr. (2.31) 
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A priori mean information contents is defined as 
be i 1,.(0)h(8)d0. 
JO 


If now, from a prior information contents /, associated with the observation x, we subtract 
information contents of the prior information, then it is possible to represent a measure of 


information gained by 
Ga i h(@) Inh(@)d@. 
JO 


Then it is assumed (in the situation of there being no exact information about a prior p.d_f.) 
to choose h(6) from the maximization condition for G. Zelner calls such a function a prior 


p.d.f. with “minimal information’. Now consider the following example. Suppose 


_ 9) 
F(x |) = a |- es a | X € (—00, 00), 


Then it is easy to obtain 
a 1 
1,(0) = -| f(x| 8) Inf(x| @)d0 = —3(In2n+1), 


that is, J,(@) is independent of 0, hence for the proper h(@) 


| 
io = ~ 5 (In2n + 1) 
and 


1 
G= =5(In2n+1)- f h(@) Inh(@) dé. 
e 
The value of G will be maximal if one minimizes a portion of the information contained in 
a prior distribution 
f= [ h(@) Inh(6) dé 
) 


The solution of this problem is a uniform p.d.f. on ©, that is, 4(@) -const. It should be 
noted that this result is in full accord with the form of a prior p.d.f. obtained using the rule 
of Jeffrey’s [114]. 


If one considers (see Lindley [143]) a functional G in the asymptotical form 


Ge [no In /nlinfa|d6 -f h(8) Inh(0)d0, 
g e 
where nis the number of independent samples from a general population, distributed by the 
probability law f(x | @), and finding a prior p.d.f., 4(@) maximizing G4 under the condition 
f 0h(@)d0 = 1, then we can obtain 


h(@) ~ |Infa|!/?, 
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that is, a prior p.d.f. corresponding to the generalized rule of Jeffrey’s, considered above, 
giving the invariant p.d.f. At the same time, as was shown by Zelner [275], if G is rep- 
resented in the nonasymptotical form, then an invariant prior p.d.f. of Jeffrey’s does not 
always appear to be a p.d.f. with “minimal information”. In the case when a prior p.d.f, 
of Jeffrey’s doesn’t maximize G, its use makes us bring additional information into the 
analysis in contrast to the case when it uses prior information to maximize G. As can be 
seen from the above conclusions, the desire of Jeffrey’s to ensure the property of invariance 
of the statistical deductions with respect to the parameter transformation deviates from the 
principle of “‘scantiness of knowledge”. Convert [46], Deely, Tierney and Zimmer [60], 
Jaynes [113] investigate the question about the choice of a prior distribution with the mini- 
mization of the direct portion of information /g (Shennon), contained in a prior p.d.f. A rule 
of choice of h(@) from the condition /g —-+ min is called an entropy maximum principle 
because the entropy Sg = —/g is used instead of /g. They introduce the term “a least favor- 
able distribution’. \f # is a family of prior distributions, then H € #% is the least favorable 
distribution under the condition, that is, its corresponding minimum of the expected losses 
is greater than that one for the other elements of a family. 

It should be noted that the estimate obtained in such a way coincides with a minimax 
one [257]. 

Deely, Tierney and Zimmer consider the use of a maximum entropy principle for the choice 
of a prior distribution in the binomial and exponential models. They show, in particular, that 
a least favorable distribution may be the best one in accordance with a maximum entropy 
principle. 


Jaynes [113] modified this principle to a more general form. He introduces the measure 


Sk =~ | 4(6)m Fovkas 


where K, as noted by El-Sayyad [73], is a suitable monotonic function. El-Sayyad proposes 
the use of a group theory approach for a choice of K(@). Such an approach results in a 
change of the parameters of h(@), which is very essential and doesn’t change the entropy 
measure. For example, if @; is a position parameter, 82 is a scale parameter (8) > 0), then 
the prior density is found so that h(6),@2) = ag(6, + b,a@), and the solution takes the 
form h(0;,@2) — 8, '. Thus, we again have obtained the invariant prior p.d.f. of Jeffrey’s. 

For the binomial model, as shown by Jaynes [113], the use of the generalized maximum 
entropy principle gives the equation 6(1 — @)h'(@) = (20 — 1)h(@), whence h(@) Ce = 
@)] |. 
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Devjatirenkov [65] uses the information criterion 
1(6) = [ / h(@ | x)p(x) ng(@ | )dxde. 
e/a 


where q(@ | 8) is the p.d.f. of the parameter with the given estimate, for the determination 
of the best (in the sense of minimum of / estimate 6. The estimate obtained in such a way 
appears to be less sensitive (in comparison with the usual one) with respect to the deviation 
of a prior distribution. It is interesting that a variance of the estimate for the Gaussian 
distribution attains the lower limit of the Cramer-Rao inequality. 

In the work [46] information quality was used not as a criterion of a choice of a prior 
distribution, but as a method of indeterminacy elimination for the determination of the 
parameters of a prior distribution density. Arguments given tn [46] are of an intuitive 
nature, but seem to be reasonable and may be used in practice. We give the main results 
of [46]. Suppose f(x | @) is p.d.f. of observation x and A(@:7) is a prior p.d.f. with the 
parameter Y. 

Analogous to a Fisher information /,(@) one introduces the so called Baves information, 
contained in h(6; y): 


A Inh(0:7) \° 


Bl,(0) = Eg ne 


(2332) 


Next one determines a weight significance w of a prior information with respect to an em- 
pirical one: w = B/,(@)/1,(@). Suppose now that 6, is a prior estimate of the parameter 6. 
If the vector y consists of two parameters y and y%, then we need to solve a system of two 


equations: 
Ey|0| mei, 
B1,(0) = wl,(@). 


In the case when the number of parameters y exceeds two, iL is necessary to use additional 


arguments (see [46]). For example, for the binomial model 
Fx (") OO) 
and a prior p.d.f. beta h(@) ~ @2-'(1 — @)’-!, we have 


HH 


OS Ty 


Jt also follows from (2.32), 


(a+b—4)(a+b—2)(a+b-1) 


Te (a—2)(b=2) 
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The system of equations for the determination of a and b has the form 
a 
—=—= — 0, 
a+b ? 
BI,(@) = wi,(8), 


where 6, and 6 is prior and empirical estimates of the parameter 0. 

The methods for a choice of a prior distribution which are based on an information criterion 
fall outside the limits of the traditional Bayes approach and are drawn either to minimax 
or to empirical Bayes methods. In the works of some authors there are many efforts to 
construct fundamental theories directed to justification of a choice of prior distributions. 
We single out the works by Japanese statistician Akaike [2-4] who proposes the methods 
of effective use of Bayes models. The goal of constructions proposed by him is a change 
of the role of a prior distribution in the Bayes models. Akaike [2] proposes to use prior 
distributions adaptive to empirical data. They are called modificators. 

In the problem of prediction of a density for the distribution g(z) of future observations 
based on a sample of obtained data, which is being solved with the help of Bayes theory, 
a prior distribution (modificator) is chosen from the correspondence between the g(z) and 


estimate 2(z), expressed with the help of Kulbak information measure 


B(s,8) = — f Inlg(2)/@(@)la(2) az 


In this capacity a mean value of entropy is used, that is E,[B(g(z),9(z | x))], where, 
s(z|x)= f fle| @)n(0 | x)d0 and (0 | x) f(x) 6)h(8). 


Thus, a prior p.d.f. is chosen by minimization of the mean value of entropy. It is interesting 
to note that Akaike’s method gives the improper prior p.d.f. of Jeffrey’s in some cases (in 
particular, in the problem of prediction of a distribution of the Gauss random vector). 
Another interesting attempt to exclude the arbitrariness in the choice of a prior p.d.f. is pro- 
posed by Bernardo [20]. He recommends choosing standard prior and posterior distribu- 
tions that describe a situation of “insignificant prior information”, and deficient information 
is found from empirical data. His criterion of a choice of a prior p.d.f., A(@) is constructed 
with the help of expected information about @ proposed by Lindley: 
h(6 | x) 
1®{e, h(8)} = [feiax [ no |3)In~ egy 49. 


where € denotes an experiment during which a random variable X with p.d.f., f(x | @), 


6 © ®, is observed. It is also assumed that A(@) belongs to the class of admissible prior 


distributions “. The main idea is interpreted in the following way. Consider a random 
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variable 19 {€ (k),h(@)} determining a portion of information about 8. expected in k re- 
currences of an experiment. We may achieve, by infinite recurrence, the exact value of 6. 
Thus, /9{€ (co), h(@)} measures a portion of deficient information about @ with a prior 
p.d.f., #(@). The standard prior distribution 2(@), which corresponds to “indefinite prior 
knowledge”, is defined as minimizing deficient information in the class .%. The standard 


posterior distribution after the observation x is defined with the help of Bayes theorem: 
(| x) ~~ m(@) f(x] 8). 


Since the exact knowledge of a real number requires the knowledge of an infinite quantity 
of information, in the continuous case we obtain 9 {< (00), h(@)} = 0. for all hi 01) = 7%. 


Standard posterior distributions for this case are defined with the help of a limit passing: 
7G | x)= jim ™.(8 | x); 
i(—?0o 


moreover, 7% (0 | x) ~ 7%(@)f(x| @), and m,(@) = argmax/® {€ (k), h(0)}. 

For the case of binomial trials a standard prior p.d.f., 7(@) ~ 8-'(1—@)~!. 

That is, we have the same result as the one in the work by Jaynes [113] obtained with the 
help of maximum of entropy. 

The attractive feature of Bernardo theory is that this theory is free of some difficulties 
which are peculiar to a standard Bayes approach, in particular, the use of standard pnor 
distributions doesn’t give any marginal paradoxes (see the works by Stone and Daw id [243]. 
and by Dawid, Stone and Zidek [56]) peculiar to non-informative prior distributions. 

An interesting approach for a choice of prior distributions, based on geometrical probabil- 
ities, is proposed by Fellenberg and Pilz [79]. They consider a problem of the choice of a 
prior distribution in the estimation of a mean value of the time-to-failure for the exponential 
distribution with the cumulative distribution function F(t:A) = 1 —exp( -Ar). For prior in- 
formation a segment of uncertainty [A,.A2] is used for the parameter A corresponding to 
the space of c.d.f. 4 — {F(t:A,) < F(tsA) < F(t: A2)}, consisting of the unknown cumu- 
lative distribution function F(r;2). Itis assumed that a probability of A being in [A;. A>} is 
equal to unity. A prior p.d.f., A(A), is determined from the condition that a probability of 
a parameter A getting into the interval [A;.x] equals the probability of F(t:A) getting into 
the space #, = {F(t;A,) < F(t;A) < F(t;A2)}. The equality of probabilities 


P{A, <A <x} = PLF (tA) © B} 


is valid because of monotonicity of F(t.A) on the parameter A. The probability P{F(t;A) € 


By} is determined from geometrical reasoning (having used a principle of equal chances) 
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as a ration of the area contained between F(t; A,) and F(t;x). The resulting expression for 


the prior density of the parameter A has the form 


ey 
me! ae ee ey 


LOO Fora de 


2.5 The general procedure of reliability estimation and the varieties of relevant 
problems 


This section is connected conceptually with the preceding four paragraphs. However, there 
are no references for the ideas discussed in them. The reader who doesn’t want to learn the 
Bayes approach from the formal mathematical positions may skip them and start with the 


consideration of the general problems of the Bayes theory of estimation discussed below. 


2.5.1 Reliability estimation 


The setting of a problem of reliability estimation consists of the following four elements: 


a) distribution of probabilities of the basic random variable characterizing the reliability 
of a technical device or system (for example, a cumulative distribution function of time- 
to-failure F(t;6), where @ is a vector of parameters; 

b) a prior probability distribution, represented, for example, in the form of p.d.f., 4(@), of 
the vector of parameters 0, characterizing the uncertainty of the given prior information 
I, about reliability; 

c) loss function, L(R,R) characterizing the losses involved when one replaces the reliabil- 
ity R by its estimate R; 


d) resting plan, II, prescribing the method of obtaining experimental data /,. 


The problem may be interpreted as follows: we need to find the estimates of reliability R 
by using a priori information J, and experimental data J. We consider below two forms of 


representation of the estimate for the reliability 


a) the set of the point estimate R and standard deviation (s.d.) which is a characteristic of 
exactness of the estimate R; 


b) confidence interval [R,R| , with a given confidence probability . 


The principal scheme for obtaining Bayes estimates is represented in Fig. 2.1. It consists 


of three steps. 
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Step 1 Composition of likelihood function ¢(6,1,). To do this we use some statistical 
model describing the distribution of the basic random variable F(t; @) and experimen- 
tal data /, obtained after a realization of a testing plan II 
Step 2 Construction of a posterior distribution h(@ | Iq,1.). Here we use the Bayes formula 
A(O | Ia)E(8 | Ie) 


. (2.33) 
i h(@ | Iq)€(0 | Ie)d@ 


h(@ | Ig,te) = 


where © is a range of the parameter @. 


Testing Distribution of Bayes 
Plan II the base random Confidence 


value F(x; 0) Interval [R. Ry] 


E ' Truthfulness Bites A posteriori 
eee Function Th ea Distribution 
esults I, 1(@ | Ie) eorem h( | In.le) 


A posterion 
risk 
minimization 


G(R) 


ape eceecekei A priori Loss 
Leper distribution paoaion 
ES (8 | laste) L(R.R) 


Renee eeccee see ceseceeeneeeees 


Pointwise 
Estimate R 


Fig. 2.1 The general scheme of obtaining the Bayes estimates 


Step 3 Obtaining Bayes estimates. The Bayes confidence interval is defined by the condi- 
tion P{R<R<R}=y7, or 


A(O | In,Ie)dO = y. 
— (8 | Taste) Y (2.34) 


To obtain the Bayes point estimate R*, we should write the function of the posterior 


risk 


G(R) = [ (8, R(8))h(0 | [y,f-)d0 (2.35) 
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and choose among all estimates R such that one minimizes the function (2.35), that is, 


R* =arg min G(R). (2.36) 
Re[0,1] 


If a squared-error loss function is chosen of the form L(R,R) = (R — R)?, then the 


Bayes estimate is determined in the form of the posterior mean value 
f° = Hh R(8)h(0 | Ip,1-)d0. (2.37) 


The error of estimation of the value of R* is assessed by the posterior s.d., Og, which 


satisfies the relation 
C= he R?(0)h(O | Ig,te)d0 — R*. (2.38) 


Example 2.1. The device time-to-failure is subjected to the exponential distribution with 


the probability density 
{GijeHae 4250, Neo. (2.39) 


As a prior distribution, a gamma-distribution with the likelihood kernel [202] has been 

chosen. The distribution density of the parameter A has the form 

pone ! e7 PA 
T'(d) : 

and the parameters 6 and p are assumed to be known. A mean square-error loss function, 

L(R,R) = (R—R)’. Asa testing plan (n,U,7] (see [91]) has been chosen. We shall discuss 


the solution of the problem in detail including finding the estimates of the failure rate A. 


h(A | Ia) = e000, p20: (2.40) 


The solution will be given in the form of the three steps: 


1) Composing a likelihood function we bear in mind the fact that as a result of testing by 
the plan {n,U,T] we have observed a censored sample. 
Suppose, for definiteness, that d of the tests have ended by failures at the instants 
1}, 5,...,t} and that n --d of those remaining were interrupted before failure after T 
units of time from the beginning. The likelihood function describing this situation is 


chosen (see [91]) in the form 
&(A Jn) =TLersay Tf sonaya (2.41) 
i= — 
Substitution of p.d.f. (2.39) into (2.41) and Eaten we have 
e(A\L)= []ae* Ge aries (2.42) 
i=l 


where K = tf +13 +---+1}+(n—d)T. Thus, the sufficient Bayes testing statistics 


appears to be as a pair of numbers (d, K). 
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2) 


3) 
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Substituting the likelihood function (2.42) and a prior p.d.f. (2.40) in the Bayes formula 
(2.33), we have the posterior distribution density 
n(A | Jaste) = (eras pene) (2.43) 
The obtained expression is a gamma-function. Consequently, the chosen prior distribu- 
tion is conjugated. 
Determine the point estimate A*. For the squared-error loss function. the minimum 
of the posterior risk G(A) is attained at the point of the posterior mean value of the 
estimated parameter, that is, 
5 2 d+6 
ue =| AR(A |Iavte)d = Se 
The posterior s.d., which may be interpreted as exactness characteristic of the estimate 
A”, is defined by the variance of the gamma-distributed random variable, that is. 
Oj. Nai ; 
p+k 
An interval estimate of the failure-rate is often used as the upper 2 confidence limit. 
Define the Bayes analog of this estimate a and putting Ay ~ 0. By definition. 
P{A < Ay} and since the posterior distribution is a gamma-distribution. the transfor- 
mation z = 2A(p + K) gives us the chi-square distribution with 216 ~d) degrees of 


freedom, we have 

P{2A(p + K) < Xy2544)} =7, (2.44) 
where Xy.9(g ,q) 18. a quantile of the chi-square distribution of the probability . From this 
relation (2.44) we finally obtain 


5, — Arad+a) 


at oe 


2.5.2 Varieties of problems of Bayes estimation 


When one solves practical problems, it ts very difficult to establish all the above-mentioned 


elements for Bayesian reliability analysis and modeling. Therefore. we need to improve 


the classification of all possible varieties. From the methodological point-of-view, the most 


essential elements can be classified as follows: 


1) 


the forming of a reliability model; 


2) completeness of information on a prior distribution (or completeness of a prior uncer- 


tainty); 
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3) completeness of information on the main random variable. 


We consider, in brief, each of these classifications. From the point-of-view of the first 
characteristic, we will distinguish two types of reliability models, giving the base for a 
corresponding approach for reliability determination. The first one (which is used more 


often) we will name “formal” and write it in the form 
€ > treq (2.45) 


where ¢ is a random time to-failure, freq is the time which is necessary, in accordance with 
technological assignment of the device or system functioning. The model (2.45) doesn’t 
touch upon real technical peculiarities of the device or system and enables us to analyze 
different (by nature) devices in a standard way, based only on the observable properties of 
the device (results of trials). 

In addition to this model, we will use a model which is based on the mathematical descrip- 


tion of real processes of the device collapse. This model, represented in the form 
ZED) \ieOiat 2 tea J = 1, 2,...;m, (2.46) 


will be named “functional”. Z;(t) denotes a random process of the initial device variables 
(loading factors, physically-mechanical characteristics, geometrical parameters, etc.); the 
function $(-) is called the survival function. 

The set of conditions (2.46) symbolizes the time of the device being operable. There are 
many works devoted to the investigation of reliability of technical devices in the framework 
of this modeling which don’t use the Bayes approach [26, 32, 89, 135, 173, and 260]. 

The questions connected with using the formal models of the device reliability will be 
discussed in the following five chapters, from the third to the seventh one, inclusive. Chap- 
ters 8—10 are devoted to the methods in reliability analysis based on the functional models. 
From the point-of-view of a prior uncertainty (the second classification property) we will 


discuss the following cases: 


(Al) The case of a complete prior determinacy, when the prior distribution density is de- 
termined uniquely; 

(A2) The case of an incomplete priori determinacy, when a prior density is not given, and is 
determined only by finite number of restrictions, imposed on some functions defined 
on a prior distribution (for example, only a mean prior value of the parameter 6 may 
be given); 

(A3) The case of a complete a priori indeterminacy, when only the finite number of esti- 


mates of the parameter @ are known. 
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The first case is the most frequently encountered and will be discussed in Chapters 3. 4. 5. 
8, 9. The case (A2) is the least studied in Bayes literature. 

In Chapter 6 we give the description of the general formal representation of a partial a 
priori information and solve many concrete problems. The case (A3) is known as empirical 
Bayes estimation and is discussed in Chapter 7. 


With respect to the third property, we will discuss the following two cases: 


(C1) Parametric, when a parametric family is given for the cumulative distribution function 
of the main random variable, that is, F(t) = F(t;@), where 0 € ©; 

(C2) Nonparametric, when this cumulative distribution function is determined on some 
nonparametric class (for example, a class of all continuous cumulative distribution 


functions). 


Furthermore, we will use, as a rule, parametric estimates, since they are simpler and broadly 
applied. Nonparametric Bayes estimates will be studied in Chapter 4 and partially in Chap- 
ter 7. In Chapter 5 we will use the so called quasiparametric estimates. They use different 
methods for an approximate solution of a problem of estimation which is set as a parametric 


one, but are solved by means of nonparametric methods. 


Chapter 3 


The Methods of Parametric Bayes Estimation 
Based on Censored Samples 


3.1 General description of the accepted estimation procedure 


Under the analysis of reliability of technical devices, the essential role is played by the 
characteristics of the device capacity for work, in particular, by the time-to-failure, TTF, of 
the device during some time interval fr: 

Re RO) = P{E > 7} (3.1) 
where € is a random time to-failure function. Throughout what follows, the characteristic 
(3.1) will be used for the investigation of the peculiarities of the Bayesian approach, taking 
into account the fact that other Bayes characteristics (for example, those of a quantile type) 
can be obtained analogously. 

The principal feature of all parametric Bayes methods is such that it is determined up to 
the parameters 0 = (6), @2,....0,) whether a cumulative distribution function F(t; @) ora 
distribution density f(t; 0) of a random variable €, is given, so that 

R=R(- Oy Siree) = [ fe @)dx (3.2) 
In the case when we are interested only in the dependence of the survival probability, SP. 
on the parameter 9, for arbitrary r, we will write R(@). The vector of parameters @ is 
determined on the set ©. The problem is that one has to estimate the SP having prior 
information and empirical data. 
Frequently, prior information is determined as a prior distribution density, 4(@), of the 
model parameters of the reliability. In many important cases (from the point-of-view of 
practice), described below, one uses another parameterization: as model parameters will 
be used r as the valuesof the TTF at some given time instants f), f2...., ty, R(t,;@). Such 
a method of representation of a parameter vector is preferred for the following practical 
reason: an engineer can form a prior representation (subjective or frequency) without us- 


ing the parameter @ which doesn’t have, as a rule, a technical interpretation. He obtains it 
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directly from the TTF. There is also a form of dual representation of a priori information in 
the form of a joint p.d.f. of the TTF at some instant ¢ and (f — 1) component of the vector @. 
When one chooses a parameterization method, he should use the following evident prin- 
ciple: the parameters of reliability models must have a clear physical interpretation. Only 
in this case, the researcher, using his informal experience, can assign a prior distribution 
adequate to real processes of functioning of a technical device. 

In this chapter and the later ones, we will investigate the Bayes procedures of the TTF 
estimation for the plan of testing with censoring the failure data. This plan is applied in 
many practical engineering situations. For example, a tested technical device is a part of a 
composite system. The halting of testing may be caused either by the failure of the testing 
object or by the failure of some other object. The last case will be called a standstill. In 
autonomous tests, the standstill may be caused by a failure of the testing equipment. The 
typical situation we meet is estimation of the equipment with the help of results of the 
exploitation. Some of the equipment elements are put into operation at different moments 
of time. One should estimate the TTF at the given moment of time. 

Let us enumerate the testing devices. For each /, the test may be ended by a failure at 
time 1; or by a standstill at the moment f;, i= 1, 2..... n. If a failure occurs at the moment 
ti <j, then the value f; will be known after the trial. Provided that r7 > 1. the exact 
value of 7 is unknown. It is known only that a failure may occur after the moment 1,. 
The random moments of failures or standstills are assumed to be mutually independent and 
have a density f(t;@). After we have enumerated the moments of failures and standstills. 
the result of testing may be represented as a vector T= {f° .r}, Where fr” = {ff .13..... tts 
Reminit...ety\. 

The technique of the Bayes TTF estimation is defined completely by the standard methods 
of Bayes estimation, discussed in Chapter 2. Starting from the sample t and using p.d_f.. 
f(t;@) we write the expression of the likelihood function ((@ | tT). The questions touch- 
ing upon the determination of ((@ | t) for the censored samples are discussed in the next 


section. Further, using the Bayes theorem, one writes the kernel of the posterior density 
h(@ | t) ~ €(6 | t)h(O) (3:3) 


and determines the normalizing constant f: 


B = fo | t)h(8) 0. (3.4) 


Then, a posterior p.d.f. takes on the form 
| 


A aes 


h(0)£(@ | 7). (35) 
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Choosing the loss function L(R,R)in the form proposed in the previous chapter, where R 
is the estimate, and R = R(@) is the true reliability measure and solving the minimization 
problem 


R* =ar min [1 R,R(0))h(O| t)de@ 3.6 
ON (@)) A(@ | 7) (3.6) 


one finds the point Bayes estimate of the reliability, R*. It should be mentioned that, if 
there are no empirical data T, one can’t use (3.6) instead ofthe posterior p.d.f., A(@ | tT), of 
a prior p.d.f., 4(@) is used. In this case R* is a prior Bayes estimator. 

If a squared-error loss function has been chosen, then the solution of the problem (3.6) is 


written explicitly: 
R = [ R(@)n(0 | x) a8, (3.7) 
1) 


that is, the estimate R* is the posterior mean value of the function R(@). The exactness of 
the estimate we have obtained can be characterized by the posterior variance (or by s.d.) 


which coincides with the minimal value of a risk function 
a2 
Op. =f [R(@) —R*|"h(@ | t) dd. (3.8) 


Since a SP is a positive characteristic of reliability, it is interesting to construct the lower 


confidence limit Ry, represented by the equation 
P{R(8) >Ry| Tt} =y, 


where ¥ is the given confidence level. Finally, the determination of Ry is reduced to the 


solution of the transcendent equation 
[ n(@ | t)d0 —y=0, (3.9) 
R(8)>Ry 


in which the unknown estimate R}, belongs to the integration domain. Thus, the standard 
parametric approach of estimating reliability is carried out as the successive application of 
the expressions (3.3)—-(3.9). We can encounter, using different parametric families f(t; 6) 
and different prior p.d.f., h(@) for the problem solution, some definite peculiarities and 
difficulties which don’t have, however, a principal value. If one estimates reliability of some 
system, the solution of a problem may be more complicated In this case, the parameter 6 
contains many components (depending on the number of elements) and the function R(@) 


is cumbersome. 


Systematization of known parametric Bayes estimates. The recent works of many au- 


thors pay thorough attention to the obtaining of Bayesian estimates of reliability. Even a 
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brief excursion in this field would be very cumbersome. Besides. the necessity of such an 
excursion appears to be dubious, because most of the results obtained in this field don't 
have a principled character. Below we give a systematization of the main results with 
the corresponding references. The reader who wants to learn some concrete results more 
deeply can find them in the works we cite. There are two complicated reviews on the appli- 
cation of Bayes methods to reliability. The first one [232] gives the analysis of works that 
were published until 1976; the second [249] is from 1977 to 1981. We present. in addition 
to these books, the systematization of the later most interesting works. We include works 
that have appeared since 1981 and a series of publications which were not mentioned in 
[2325247 

The following principle is taken as a basis of classification: all the works divided into 


groups characterized by: 


a) a form of the parametric family; 

b) a form of a loss function; 

c) achoice of a prior distribution; 

d) plans testing for obtaining estimates; 


e) structure type of the technical system, the reliability of which is being tested. 


In accordance with the first characteristic, all works are divided into the following sub- 
groups: binomial models [68, 71, 88. 197, 201, 234, 263, 268]. models with a constant 
failure rate [11, 22, 147, 149, 164, 185, 255], Poisson models [37, 103, 107, 189, 230, 
267, 268, 271], the case of normal distribution [96, 264], the case of gamma-distribution 
(66, 104, 116, 157, 255, 264]. models based on a Weibull distribution [7. 33. 40. 44. 78, 
119,186, 237, 251], and models with a log-normal distribution (175. 182]. In all these 
works, the authors use a natural parameterization of the corresponding distribution fami- 
lies. This means that if, for example, the Weibull cumulative distribution function is written 
in the form F(t: @,0) —exp[—(t/o)®), then as a priori information is used the prior p.d.f. 
h(a@.o) of the variableswhich are model parameters. The use of corresponding results is 
impeded in practice, because the engineer-researcher usually meets some difficulties. when 
he forms a priori representation with respect to parameters having an often abstract nature. 
What actually happens is that a researcher has direct information on the degree of reliabil- 
ity. For example, for the above-mentioned above Weibull model, the interval of TTF values 
at the moment to: R,, — | ~ F(to:@.o), is given and, having this information, one should 
obtain the Bayes estimate. Similar situations will be considered at the end of this chapter. 


In accordance with the second characteristic (a form of a loss function), the publications 
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are considered more distinct. The most of works use a quadratic loss function [17, 22, 
37, 40, 44, 48, 96, 100, 105, 107, 150, 167, 184, 189, 230, 238, 258, 268] which gives 


the Bayes estimate in the form of the posterior m.v. In the work [157] a loss function 


R-R( 6)| is used. Some authors (see [60, 230, 258] accentuate the quadratic loss functions 
[R— R(8)]’/R(@) and [R— R(6)]”/R(8)?, giving the estimates {E[R-! | t]} and E[R~ | 
| PE pa? | t| respectively. In the works [73, 258] the authors introduce and substantiate 
the usefulness of a loss function having the forms 

2 


C(R(8)) [Re —R°(6)| C(R(@)) [Ink —InR(0)]”. 


In accordance with the third characteristic, we divide the works into four subgroups. To 
the first group belongs the works [1, 2, 29, 31, 36, 37, 38, 44, 66, 68, 96, 97, 100, 105, 
109, 139, 147, 157, 163, 167, 183, 189, 190, 228, 234,237-241, 267, 272] which deal with 
conjugated systems of prior distributions. In the second group we include publications [17, 
40, 44, 48, 95, 105, 141. 150, 186, 263] in which the authors attempt to use objective 
prior distributions. They either construct prior distributions based on the given statistical 
data of previous information, assuming that statistical mechanisms possess the property of 
stability, or apply the empirical Bayes approach. In the works [29, 100, 105, 157, 175, 189, 
215, 230], the authors use the subjective discrete or uniform prior distributions. And, at 
last, in the fourth group we include a few publications [6, 60, 75] which use a principle of 
entropy maximum, considered in Chapter 2. Thus, we may come to the conclusion that in 
these works the authors attempt to avoid the assignment of the subjective prior distribution, 
doing this only in the case of the discrete representation. 


In accordance with the fourth characteristic, the following four plans are used most often: 


1) n articles are tested with fixing of a failure moment, the testing’s are interrupted, when 
r <n of failures have occurred [8, 22, 44, 69, 157, 163, 167, 236-240, 258]; 

2) n articles are being tested during the given time interval T and fixed the number of the 
articles which failed [103, 107, 268]; 

3) n articles are tested with fixing of the time they have failed, the testing are interrupted, 
when all articles have failed [184, 186]; 

4) during the testing of 7 articles failure moments are fixed, the testing is interrupted after 


the given time T has been ended [22, 31, 69, 155]. 


The last, and, fifth, characteristic enables us to subdivide the publications in the following 
way. In the works [29, 234, 241, 248, 271], the authors estimate the reliability of parallel 
systems, in the works [97. 148, 158, 159, 190, 197, 238-240, 261, 271] the reliability of 
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sequential systems. Composed (parallel-sequential) schemes are considered in the works 
(3a), 138; 139]. 

Finally, in the works [1 19, 268}, the authors consider systems which differ from the above- 
mentioned. 

Taking into account our arguments, mentioned above. we can make the following conclu- 
sion. In spite of the great variance of the solved problems, the questions of TTF estimation 
by the censored samples under the assumption that a priori information is given in the form 
of a prior distribution of the investigated reliability degree remain open. We complete it in 


the following section. 


3.2 Likelihood function for Bayes procedures 


One of the compound parts of any Bayes procedure of estimation is the composition of 
a likelihood function. In the simplest case for the testing plans without censoring. the 
likelihood function is written in the form 

n 

Ht) =a (ae 8) (3.10) 

=| 
Questions concerning construction of a Jikelihood function for the censored samples are 
discussed by many authors (see, for example. [31, 123]. The most complete formalization 
of the procedure of random censoring is done in (14. 15]. We represent below the main 
principles of this formalization. 
Suppose that n are tested. Each /-th testing is associated with twonumbers ft; and ft) (i = 
1,2,...,m), t7 is a failure moment, f; is a censoringmoment. Failure moments f°. with 
the gap of censoring, are assumed to be mutually independent, equidistributed random 
variables with ac.d.f. F(r;@). A sample T (7), T..... T,), corresponding to the general 


plan of testing, has form 


CSA ae,;.-- 1 Teepe eee ken (3.11) 
where the set J = (i),/2,...,ig) is compounded by numbers of articles for which failures 
arerohservedwandithesset J = (fy vjasc.s. Ja) Numbers of articles for which the failures are 


being censored. The set T),T},...,7,,T1,-.-, T is considered a random vector. 

Further it is supposed that a cumulative distribution function of the whole set of random 
variables possesses the following property: the conditional distribution t).1..... ty (under 
the condition that nonobserving values of failure moments ofp = ti, a, o, > tj,, and ob- 


serving ones T < Tj,,.-.,T;, < tj, is independent of @ and may depend only on the values 
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qi, ees Tj, Under the assumption of the existence of joint p.d.f. values 1;,this means that 


for the conditional p.d.f., the relation 


* 


PiGbeeatalti lp eo en A eceat (3.12) 


holds, where 
Fiaee viel, t,>t;,, Vi ed. 


The plan of testing with censoring, satisfying the relation (3.12), is called in [14] a plan of 
testing with noninformative censoring (NC-plan). 
Note that the condition (3.12) is fulfilled, if the sets of all failure moments (a. Cisse te) 
and the sets of all censoring moments 1), f2,...,fn are mutually independent. This exact 
situation occurs when f; are independent with respect to i and don’t depend on all ti, j= 
1, 2,...,n). Such an assumption looks natural when one carries out a testing of articles 
with two types of failures, when each test is continuing up to the moment until a failure 
occurs. We indicate the type of occurred failure. The sample, obtained in this way, has 
aufom tT = (74 %2;..-,%m), wiele t; — Tiny t 4)... The eyent 7 — 77 (t; = 4) responds to 
the case when the first (second) type failure has been occurred before the occurring of the 
second (first) one. 
For the establishment of the likelihood function, we write a joint density of the observed 
data: 

Be erate tie ath) =| dt; 


ti 


OO a] n 
of atg f ary. [ dt TL F(t:0) p(thy.--ste | thst). 
fi iy thy | 


Integrating t;,...,t7, over, in accordance with (3.12), yields 


d k 
pec 8) — [a 6) Fr, @)| (2); (3.13) 
m=\ 1 


where 
en) = | dn, | Quai tigmeestayl ta 2=2t,) 
Es it 
iy id 


is independent of the parameter 6 and defined only by the obtained data. We rewrite the 
expression (3.13) in a more suitable form in order to determine reliability degrees. To this 


end we use the function of a failure rate 


yee Ge) 
Amey (3.14) 
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and the resource function (or the integral function of intensity) 
bi [os] 
Ne i; A(x;0)dx = | v(t —x)A(x; 0)dx (3.15) 
Jo 0 


where 7(z) = 0 for z < 0, and x(z) = | for z 20. 


Note that, since 
R(t; 0) = 1—F(t;@) =exp \-f A(x8)dr 
for the resource function we obtain 
A(t; 0) = —In[1 — F(t; 0)). (3.16) 


Let us transform the expression (3.13), using the relations (3.14) and (3.16): 


p(t|@)= ct [PatH0) {+ YA(t7;0) + Fano) \. (3.17) 


iel iel jes 


The expression (3.17) can be simplified with the help of (3.15) in the following way: 


YA(H:0)+ Y AG: 0) = ie Vix (t-17) “Exnanla (tO \dr 


iel jel ic jel 


= N(t)A(t; O)dt (3.18) 
0 


where N(rt) is the number of articles being tested at the moment 7. By using the relation 
(3.18), we can rewrite (3.17) as 

p(t|0)=[]A (7s0)exp{ ~ f nna(e.e)ar c(t) (3.19) 

ict 0 

The distribution density p(t | @), represented as a function of the parameter @, by definition 
is a likelihood function for the (NC)-plan, corresponding to the censoring data Tt of the form 
(3.11). Throughout what follows we will use the notations t* ~ (1)... ae t) 
for the moment of failure and moment of censoring, respectively, observed in n = d +k 
independent testing’s. 
Following these notations, we can rewrite the likelihood function ((@ | tT) as one of the 


following equivalent expressions: 


= 


d 
(6 | t)=c(t) [ff tt — F(t;6)), (3.20) 
i=] 


0 a eq]? (t?;0)exp 


= Eacso) : (3.21) 


(6 | t) = TTA: :8)exp | ~ ie N(A(t: e)at) (3.22) 
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We use one or another of these expressions, depending on convenience, giving the posterior 
p.d.f. A(6 | t) and on the manner of representation of the parametric family of distributions 
the random variable of a trouble-free time of functioning. In concluding this section we 
note that the assumption about the randomness of the censoring moments doesn’t play an 
essential role in the above reasoning. In the case more general than those considered earlier, 
for each testing is planned the duration t/ (i = 1, 2,...,) that cannot be exceeded. Thus, in 
each testing it is observed the minimal of three quantities t = min{t},t;,t/}, and the sample 
hasa form t= (1). Pate: a tht, ths. sty), where kK’ +k” =k,n =d +k. To formalize 
the given testing plan mentioned above, one should consider the set of random variables 
{tf ,..-5ff,t,-..stn, t},---t,}, having a joint density 

n n 

poe E52 alan. at [tis of) ET 85(5) 

= j= 
where 6,(t (ti -)is the delta-function. Applying the transformations, analogous to those that 
have been used for p(t | 8), we obtain 

d K x’ 
p(t| 8) = IT f(s, i ails eNe Ptteae 
eal = s= 


This expression coincides with (3.13), if one puts k’ +k” = k and supposes that the moments 
of random and determinate censorings don’t differ. Therefore, the relation for the likelihood 
function (3.20)-(3.22) remains valid, not only for the random censoring, but also for the 


determinate one. 


3.3. Survival probability estimates for the constant failure rate 


The case of the constant failure rate A(t) = A = const.) is associated with the exponential 
distribution of the TTF with p.d.f. 


f(t;A)=Aae™ 
and with the cumulative distribution function 
PA. 


This distribution is one-parametric. The probability of the trouble-free time at some mo- 


ment fo is written in the form 


R=R(to:A) =e". 
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In view of the arguments mentioned above. we consider a situation when the prior distri- 
bution is defined directly for the estimated TTF. i.c.. f(r) is given. Represent pedal f(t Ay) 


and c.d.f. F(t;A) in accordance with the parameter r = exp(—Ato). This yields 


A= Ar) = eur 
10 
whence 
f(t,A(r)) = <2 ee (3.23) 
0) 
and 
F(t;A(r)) =r/. (3.24) 


Substituting the expressions (3.23) and (3.24) into (3.20), we obtain the likelihood function 


which corresponds to the sample t for the NC-plan oftesting: 


ie . 
Lt) = cle) (-~) Pole (3.25) 
0 
where 
| d A 
@ = (Tt) = — eee 
OMI = 


is a total respective operating time of testing that generates. together with the number of 
failures d, the sufficient statistic with respect to the sample t under the NC-plan. 
In accordance with the Bayes theorem (3.3), for the posterior p.d.f. of the parameter 7 we 
have 

h(r|t) ~ h(r)r® In? r. (3.26) 
For further investigation we choose a quadratic loss function. Tt enables us to write the 


following expressions for the Bayes estimate R* and posterior variance. respectively: 


] 
au i h(r)r®* "nd rdr, (3.27) 
B Jo 
4 ] 5 A x2 
o}, = ma h(r)r®*? in? rdr — BR’, (3.28) 
JO 


where B = fa h(r)r@ In rdr is the normalizing constant. The lower contidence TTE limit. 
in accordance with the expression (3.9), can be found from the equation 
1 1 
ia h(r)r® In? rdr = yf h(r)r®€1n? rdr (3.29) 
Ry J0 
where Y is a confidence level. 
In the general case for the practical application of the relations (3.27) (3.29). we need to 
use numerical methods of integration and numerical methods for the solution of transcen- 
dent equations. Often we can mect such situations when f(r) is chosen by the frequency 
relations and appears to bean approximation of some empirical equation. (We'll represent 


below, from the point-of-view of practical interests, some of the most important cases.) 
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3.3.1 The case of uniform prior distribution 
Suppose that R is subjected to a prior distribution with p.d.f. 


SD R <rg R ’ 
h(r)=& RyRy z (3.30) 


0, Ei PSU y 
This case is typical for the practical situation when a researcher, using the previous ex- 
periment, can guarantee that a value of TTF of the created device will not fall outside the 
interval [R;, F,,]. In accordance with (3.27) we obtain 
Ru at 
| r°+ lin? rdr 
a ns (3.31) 
i r? In? rdr 
Re 


For the application of formula (3.31) we use the following integral, which can be easily 


found: 
O1.n OHI k_(k) In 
[: in xdx =x ey n +n t& (3.32) 
where n/*) = —@ ;is the number of arrangements of k elements from n elements. The 
(n—k)! 8 


expression (3.31) is written as 
R= Te (Ru, @ + 1,d) —Ig(Re, @ + 1,d) 


: 3.33 
Te (Ry, @,d) — Ip (Re, @,d) ( ) 
where the function /¢ (x, a,n) is given follows: 
= 1 i s4| 
ian) =s" 3.34 
Ean) = Ss eat (a+ ijk (3.34) 
The expression for the posterior variance can be found analogously: 
op. - I (Rus @+ 25a) = Ie (Re, @+ Dea) 7 pre. (3.35) 
Te (Ru, @,d) = Ty (Re, @,d) 
In this case the equation (3.29) has a form 
Ir: (Ry, @,d) = (I ai Ye (Ri, @,d) ate Yr (Re, @,d). (3.36) 
The case R, = 0, R, = |, i.e., a TTF is distributed uniformly on the segment [0, 1], will 


be of interest to us. We name it as the case of trivial a priori information. The formulas 


(3.33)-(3.35) are simplified substantially: 
1 d+l 5 o+1 d+] me 
i - Of. = | —— — R**, 337 
: (: a3) 2 ss & Gan 


d 
Vitagt ee linr*|** = Ba — 4). (3.38) 
k—0 ‘ 
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Let us compare the estimates (3.37) with the maximum likelihood estimates. To this end 
we use the likelihood function (3.25). After solving the likelihood equation 9 Inf (r| t)/dr. 


we obtain 
Rap=e/®, (3.39) 
Next we find the minimal estimate of the variance. Then, in accordance with the Kramer- 
Rao inequality, 
D[Raalizies”, 
where 
n= [f zsean] 
nj=/ ——a 
f(t;A(r)) 


For the given case 


| 
—- 
(") rin? r 
whence, 
DR 2 ny Oe ae (3.40) 


Let us compare (3.37) with (3.39) and (3.40) respectively. It is easily seen from the expres- 
sion (3.39) that Ry = | ford = 0, 1.e., we cannot apply the maximum hkelthood estimate 
for the case of completely successful tests. At the same time, the substitution ¢@ = 0 into 
the expression (3.37) gives us R* = (@ + 1)/(@ +2) and the case R* = | is realized only in 
the asymptotic n — oo, Analogously, for d = 0 in the expression (3.40) we obtain Dry, = 0 
and Ce : 
In Table 3.1 we represent the results of numerical comparison of R* with R,y and O;.. with 


as it follows from (3.37) is always positive and tends to zero onlyas n — ©. 


Dyin for a broad range of values of sufficient statistics. As can be seen from the given 
numerical values, 65, < Dmin for d > 1. 
Compare now the lower Bayes confidence limit for the case of trivial a priori information 


with a usual confidence limit (for d = 0) 


Ry = (1—y)'/", (3.41) 


which holds for the plan {N.U.7] under completely trouble free tests. For d = 0. equation 
(3.39) gives us 


Ry=(1-yi/ler) (3.42) 
If one reduces the formula (3.42) for the plan [N,U, 7], it yields 
Ry es (1 Sayiiiant): 
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Table 3.1 


Ro 2 
0.367879 0.421875 0.135335 0.038022 


@ 

2 

3 | 0.513417 0.512000 0.117154 
| 4 | (0.606531 0.578704 0,091970 
0.629748 | 0.071895 
| 10 | 0818731_[ 0.70255 | 0.026813 | 0.012534 
[20 [0.904836 [0.869741 | 0.008187 0.008708 
0.909149 | 0.003890 
[40 [0951229 [0.930259 | 0.002262__| 0.001474 _| 
[so | 0960789 [0943410 0.001477 | 0.000088 _| 
0.985222 | 0.000088 
0.990099 | 0.000044 
[400 [0.995012 0.992556 | 0.000025 | 0.000019 _ 
[soo | 0.996008 [0.994036 | 0.000016 | 0.000012 


[4 | oares67__|0482s3_|o.2ssi1_| 0.027740 | 

| _5 | osagei2 | 0.39775 0.108430 | 0.025049 _| 

[to | 0.740818 | 0.706067__[ 0.049393 | 0.014092 _| 
20 | 0.860700 0.830207 
30 | 0.904837 0.880738 
40 | 0.927743 0.908 109 
100 | 0.970446 0.961357 0.000948 0.000355 

[300 | 0.990650 | 0986821 _| 

| 400 | 0.992528 | 0.990087 0.000055 0.000024 

| 500 | 0.996008 | 0.992056 0.000036 0.000016 


In the work [120] the estimate for the plan [N,U,(r,T)] was obtained which, for a constant 


failure rate, results in the sufficient statistic (d,@).This estimate has form 


th CES 
<a V:2(d +1) 
Ry =exp( -— EE (3.43) 


where lia a+1)i8 a quantile of the chi-square distribution. 

In Table 3.2 we represent the values of the estimate (3.43) and the lower Bayes confidence 
limit in accordance with the equation (3.38) for a broad range of sufficient statistic values. 
Having compared the results of the table, we may conclude that R}, > Rie that is, the Bayes 
confidence interval is always smaller than the usual one. At the same time, the estimates 
Ry and R’, have equal limits as n — co and their values almost don’t differ beginning with 
@ = 40. 


The analysis we have performed lets us as certain that the Bayes estimates are more effec- 
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Table 3.1 (continued) 


ee a 
2) 0.367879 0.421875 0.135335 0.038022 
3 


0.513417 0.512000 0.117154 () 034153 


4 0.606531 0.578704 0.091970 0.029534 
5) 0.670320 0.629748 0.071893 0.025306 
10 0.81873] 0.770255 0.026813 0.012534 
20 0.904836 0.86974 | ).008 187 0.004708 
30 0.935507 0.909149 0.003890 0.002426 


[40 | 0.951229 | 0.930259 0.002262 
0.960789 0.943410 0.000988 
| 100 | 0.980199 0.970876 0.000272 


9.990050 0.985222 0.000098 0.00007 | 
0.993356 0,990099 0.000044 | 0.000032 

400 | 0.995012 0.992556 0.000025 9.000019 
0.996008 0.000016 0,000012 


3 | 0.367879 0.135335 0.029759 
o.assi1__| 0.27740 
§ | 0.548812 0.108430 0.025049 
[10 | 0.740818 [0.706067 | 0.049303 | 0.014092 
0.016668 | _ 0.005726 
0.0081 | _ 0.003037 
| 40 | 0.927743 0.001873 
50 


0.941763 0.925268 0.003193 0.001268 


od 


100 | 0.970446 0.961357 0.000948 0.000355 
200 | 0.985112 0.980344 0.000218 0.000094 
300 
400 | 0.992528 0.990087 0.000055 0.000024 
500 | 0.996008 0.992056 0.000036 


tive. Therefore, by using them in practice we can substantially reduce the number of tests 
necessary for the confirmation of the given reliability requirements. In order to clarify the 
quantity relations between the necessary volume of tests @,o4 Which we need to carry out 
by using the Bayes methodology and the volume @reg of tests which we have to perform 
by using non-Bayes methods, one performs a numerical modeling of the process of exper- 
imental functioning of the object on the given reliability level Rreq. The values Deg and 
@req were defined from the conditions Ry = Rreq and Ry = Rreg. 

Figure 3.1 shows the behavior of the relative gain in the number of tests Wreq/ req 
ing on a prior confidence level R,; (when R,, = 1) for different Reg. As can be seen from 


Figure 3.1, the gain may substantially increase. 


depend- 
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Table 3.2 


d=0 d= d=] 
Bs Ris | Bis 
[1 | 0316229 | 0.100009 [00 [00 [pee 
ore 


Ry 
0.562342 | 0.464172 | 0.378163 | 0.273488 | 0.264325 | 0. 
0.630958 | 0.562353 | 0.459350 | 0.378184 | 0.344914 | 0.264312 
0.681292 | 0.630968 | 0.5229742 | 0.459370 | 0.411686 | 0.344900 
0.794335 | 0.702148 | 0.677768 | 0.616408 | 0.587282 
0.865964 | 0.857701 | 0.784187 | 0.771592 | 0.717025 | 0.701290 
0.896151 | 0.891255 | 0.830918 | 0.823267 | 0.776124 | 0.766343 
0.926121 | 0.882078 | 0.878403 | 0.842242 
0.936332 | 0.897584 | 0.894824 | 0.862567 | 0.858927 
0.951177 | 0.950120 } 0.918917 | 0.917197 | 0.890740 | 0.888449 
0.959716 | 0.959001 }| 0.932898 | 0.931724 | 0.909335 | 0.907762 
0.965714 | 0.965197 | 0.942768 | 0.941917 | 0.922525 | 0.921378 
0.970157 | 0.969766 | 0.950107 | 0.949462 | 0.932366 | 0.931493 
0.973581 | 0.97327 | 0.955778 | 0.955272 | 0.939989 | 0.939303 
0.976300 0.960292 0.946068 
0.977238 | 0.962290 | 0.961852 | 0.948668 | 0.948167 
0.984867 | 0.984767 | 0.974569 | 0.974403 | 0.965367 | 0.965139 
0.988554 | 0.980834 | 0.980740 | 0.973868 | 0.973738 


0.988610 
0.992380 | 0.992354 0.987160 | 0.987119 | 0.982473 | 0.982415 


0.994275 | 0.884260 | 0.990347 0.990323 | 0.986816 | 0.986782 
0.995415 | 0.995406 0.992266 | 0.992251 | 0.989433 | 0.98941] 


* 
Rio Roo 


U 
Rel 


300 


3.3.2 The case of a prior beta-distribution 


There are practical situations when an engineer has information about a pointwise prior 
estimate Ro of the TTF and information about the error of itsdetermination in the form of 
a prior variance Ge In this case, as ascertainedin [43], a prior distribution can be approxi- 


mated by a beta distribution with the p.d.f. 


ee al = = 
he ee Oe rei, 3.44 
where B(a, B) = i x*-1(} -x)B | is a beta function and parameters a, B are defined as 
Ro(1—R Ro(1—Ro 
a = Ro ee 1), B =(1—Ro) [a=]. 
se OG 


Due to the Bayes theorem on a prior distribution density, we have 


h(r | t) ~ r%9(1 —r)P in? 5, (3.45) 
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0.95 0.96 O97 0.98 0:99 


Fig. 3.1 Illustration of the gain in the testing volume under using of Bayes procedures. 


whence one obtains the following Bayes estimates: 
a,  Ip(@+1) Ipn(@+2) 2.5 
R* = ——_——,_ 0g. = ——_—— - R-. (3.46) 
Iz(@) z In (@) 


where the function /g(v) is defined by the integral 


1 
Ip(v) =| pee ny — x)P-"| Inxl|4dx. (3.47) 
0 


For the highly-reliable articles @ + @ > 100. in the integral (3.47) we can use the approxi- 
mation Inr ~ (1 —4). The point is that for @ + @ > 100, the posterior density concentrates 
in the domain, adjacent to the unity, so that its values outside of the interval [0.9: 1] are neg- 
ligibly small and the approximation, indicated above, gives satisfactory results for practical 
use. 


Finally we have 


pre AtoOtiBtd) _ ata 
B(a+@,B+d) ato+Bp+d' Rots 
Pie (a+@)(B +d) - 


RW (a@+B+d+o)*(a+Btd+arl) 
It should be noted that the expressions we have obtained give us the exact values of the 


required estimates for d = 0, 
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3.4 Reliability estimates for the linear failure rate 


The case of a linearly increasing intensity function A (tr), corresponding tothe deterioration 
of exploitation conditions or wear of the article, is a development of the previous model. 
Suppose, as before, that we have to estimate the TTF, R = P{& > to}. Because the failure 


rate during the time interval [0, fo] is changing linearly, it becomes z-times worse: 
ee) 
ROS 1) 
We name the quantity z as a degradation degree of the intensity function.Clearly, provided 


(3.49) 


that z = 1, we have the previous case A(t) = const. 
Represent the function A (t)in the form of the following linear function: 
A(t) =2at + Ao, 
where @ and Ap are the parameters of linear function. The function A(t) associates with 


the density of the time to failure, TTF, 


f(t) = f(t:00,Ao) = (at + Ao) exp [—(at? + Aor) | (3.50) 
and with the distribution function 
F(t) = F(t;a, 49) = 1 — exp [—(art* + Ap)]. (3.51) 
The estimating reliability index is written in the form 
R = R(a, Ao) = exp(—axt} + Aoto). (3.52) 


This parameterization is a natural generalization of the previous model. However, the pa- 
rameters of the functions (3.50)—(3.52) don’t have a sufficiently technical interpretation. It 
is more suitable, for these reasons, to use the parameters r and z, where r coincides with 
the estimating TTF and z has been defined earlier in (3.49). As was mentioned above, it 
is substantially easier to form a priori representation immediately about reliability index; 
the parameter z has a clear interpretation and indicates how many times the failure rate has 
increased in the interval {0,fo]. It is also suitable that r and z are dimensionless parame- 
ters. Throughout what follows it is assumed that we are given a prior distribution h(r,z), 


(r,z) € Q, where Q is the given domain of parameters. Solving (3.49) and (3.52), we obtain 
7 Inr z-1 2Inr 


2 = ee 3533) 
i oa! a to(z+ 1) \ 
After that we can express p.d.f. f(r) and c.d.f. F(t) in terms of dimensionless parameters 
zandr: 5 
2Inr t ates ae 
t)f(t;r,z) = -———— |(z-l taafr 0 oe 
fl f(tsn2) = - A [e-3 
clare yea 
a iy a 


FO Ce 
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After substitution of these expressions into (3.20) and some arithmetical transformation, 
we obtain the likelihood function for the reliability model with a linear intensity function 


and NC-plan, giving the sample T: 


d 
2 {-) 
€(,z| te c(t) (-2) a(z)rP®) In? r, (3.54) 
0) 
where 
Il d 
a(z = 5] Life= yj + 1 
(s i yl 
(2 cee 
~ 744 ak 
d k d e k P 
wo Vay iy. me yarey a 
=| i=] f=) 
e t; 
=o y=. 
fo ~ fo 


The quantities v7 and v," have, respectively. the sense of reduced dimensionless moments 
of failure and censoring. As seen from the expression (3.54), one can use instead of the 
vector T the union of vectors v" and ¥, composed of the outcomes of the tests. The quantities 
{v},v3,-..,¥%,d,@,k} form the sufficient statistic. 

In accordance with the Bayes theorem for the posterior density of the parameters » and 2. 


we have 
h(r.z|r)~h(r)a(r)? In! r. (3.55) 


If the value of the degradation index 2 ~ Tis taken exactly, we need only a prior distribution 


of the parameter r. In this case tor the posterior p.d.f. of the parameter r, we obtain 
h(r|t) ~A(r)r? In? r. (3.56) 


Besides, provided that = 1, we have b © @, and relation (3.56) coincides with (3.26). ob- 
tained for the case A — const. The sufficient statistic for the case, represented by (3.56), has 
a simpler form than the one tor the general case, where itis settled by the three quantities 
{d,@,k}. 

Consider the wide spread case when an engineer can guarantee some interval (R,.R,\ for 
the estimating reliability R before the beginning of testing. 

In accordance with this, we'll assume a priori that R < [R,.R,,|. and the degradation coefi- 


cient of the failure rate z belongs to the interval [z;, za]. 
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Let us take for z and r uniform prior distributions in the intervals [Re, Ry] and [z1,z2] re- 
spectively; moreover, we'll assume that r and z are a priori independent. The expressions 


for the Bayes estimate R* and posterior variance 62. are written as 


= 1 z2 Ry 
Ress al dz [ ra(z)r?) in? rdr, 
B Jz, Ry 


1 22 Ry 
C—— dz [ ?a(z)r in? rdr — R*, 
Zz) Re 


RB 
where 


Z2 Ry 
B = dz | a(z)r?(z) In? rdr. 
ra] Re 


Using the integral (3.32), we can reduce these expressions to one dimensional integrals 


which can be numerically integrated. Introduce the function 
Ry 
I (z; Ry, Ry,m, d) — i: xP(z)+m In? xdx 
Re 
= Ip (Ry, b(z)+m,d) — Ig (Rp, b(z)+m,d), (3.57) 
and the desired estimates can be expressed by 


, | 3 
R* = a a(z)Ip(z,Re,Ry,1,d)dz, 
Z] 


| 
Silat 


L ; (3.58) 
/ a(z)ly(2.Ry.Rr.2,d)de— R°?, 
mall 


where 
p= | * ale) (e.Ran Rs 0nd) 

For the determination of the lower — confidence limit we have to solve the equation 
[aen (z,Ry,Ru,0,d) dz = 7p. (3.59) 


The calculations based on (3.57)—(3.59) require special numerical methods. We have solved 


this problem with the help of an algorithm written in FORTRAN-IV. 


Example 3.1. The following relative operating times v* = (1,3), v = (2,4: 3.1: 2.8: 1.6: 
2,4; 3,4; 4,2; 1,8; 2,5; 3,0) were fixed during the statistical testing, that ts, one test was 
ended by failure and ten by standstills. We know (taking into consideration a priori infor- 
mation) that a reliability index is not less than 0.9, and a degradation coefficient takes on 
a value from the interval [1.0; 2.0]. Calculation base on (3.57)-(3.59) gives the following 
values of the posterior estimates: R* = 0.9576, Og. = 0.0242, a lower confidence limit (as 


Y= 0.9) Rig = 0.9216. 
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The more simple case (bearing in mind the numerical analysis) is one that corresponds to 
the fixed value of the parameter z, having the posterior density of the type (3.56). 


The final formulas for the desired estimates are written with the help of the function (3.57) 


as: 
pe = Le RoRw bd) o _ F(Z, Re, Ru 2,4) — Rr. (3.60) 
ly (z,Re,R,0,d) R Iy (z,Re,R,0, d) 
The value of Ry is found from the equation 
Ip (z,R},Rus0,d) — Ye (z,Re,Ru,0,d) = 0. (3.61) 


Example 3.2. The initial data for this example differ from those in the previous case only 
by the condition that gives the exact value of the degradation coefficient z ~ 2. The calcu- 
lations by formulas (3.60) and (3.61) yield: R* = 0.9729. Og- = 0.0181. Ri 4 = 0.9476. 


We have performed a lot of computations using the formulae (3.60), (3.61) in order to 
learn peculiarities of the Bays estimates. In Figures 3.2-3.4 you can see. respectively. the 
behavior of R*. Og. and Ry as functions of the lower bound R; of the indeterminacy interval 
(as R, = 1) and degradation coefficient z. The calculations were performed with the help 
of the special algorithm for three samples: 

Sample 1: v* = (0.80; 0.85); 


v= (1.10;0.95;0:90:51.1570.75: 090: ONS: 1:20: 1-15; Pee 
Sanmiple 2: v* = (1.10; 1.80); 

y= (1.30; 1.2050 1050.30: 1515: 140) 120; 1-70; 1.50: 2100). 
Sample 3: v = (1.30); 

v = (2.40; 3.10; 2.80; 1.60; 2.40; 3.40; 4.20; 1.80; 2.50; 3.00). 


The order of the decreasing of a number of the samples corresponds to improvement of the 
experiment results. 

In Figures 3.2 -3.4, solid lines correspond to the estimate of TTF for the first sample. dotted 
lines are for the second one, dot-and-dash lines are for the third sample. Analysis of the 


graphs enables us to draw the following conclusions: 


1) While the number of samples is increasing, estimates of the reliability index is improv- 
ing; 
2) For each sample there exists its own dead zone for the change of R;.moreover, this zone 


moves to the right as results of experiments improve; 
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Fig. 3.2 The pointwise Bayes Estimate. 


3) If one increases the degradation coefficient, the posterior estimates improve for the same 


samples. 


The last conclusion is logically interpreted in the following way. Suppose two tested arti- 
cles with the degradation coefficients z; and z2 (z; > Z2) give the same results. Clearly, that 


the most reliable will be article whose degradation coefficient is larger. 


3.5 Estimation of reliability for the Weibull distribution of a trouble-free time 


Consider the case when the trouble-free time € is subjected to the Weibull distribution with 


the density 
f(t;A,a) =Aat* exp(—Ar®), (3.62) 
and c.d.f. 
f(t;A,a) = 1—exp(—Ar®). (3.63) 


Then the estimating parameter of reliability during the period of time fo iscomputed by the 


formula 


R=R(A,a) =exp(—A¥). (3.64) 
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Fig. 3.3 The posterior mean squared value of the TTF. 


The expression for the reliability function, when one realizes an NC-plan.may be obtained 


after we have substituted the relations (3.62) and (3.63) into (3.20): 


ii aod 
€(A,a| t) =e(t)A% a4 fr) exp(—Aarf). (3.65) 
i= 
where 
d k in , 
o=a(a)=) (7)*+) vt, v =o \ =i. 
i=| j=\ 0 0 


Reasoning analogously as in the previous paragraph, we may conclude that the given pa- 
rameterization is not suitable in practice. Therefore. instead of A, we will use the parameter 
r introduced earlier, Let us express the likelihood function in terms of rand a. To do this 


we use the dependence (3.65). It yields 


| 
A sae nile ~ (3.66) 


Next we substitute (3.66) into (3.65) and obtain 


d 
e(r,a@| t) =c(t) (-+) int. (3.67) 
0 
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Fig. 3.4 The lower Bayes confidence limit of the TTF. 


where 


d 
= []7- 

i=1 
It should be noted that for @ = 1, the Weibull distribution model changes into an exponen- 
tial one, and the likelihood function (3.67) coincides with (3.25). 
Assuming that p.d.f. A(r,@) is a priori given and using the Bayes theorem, we obtain 

h(r,a|t) ~ A(r,a)otp®'r In? r. (3.68) 

The dependence (3.68) appears to be initial for obtaining any estimates of reliability R. In 
particular, if the parameters r and @ are distributed uniformly in the intervals [R,,R,] and 
[Qt , 2], we obtain 


h(ra|t)~otpt intr, re [Ry,R,],a@ € [a, 0], 


whence 


; Ry 
R= z a [vw uw! +1 in? rex, 
Ry 
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where 
= ar [a ir” nerd. 

Calculations, based on these mene can be simplified if one uses the integral (3.32) 
and introduces the function 

Iw(@,Re,R,,m,d) = In (Ry, @(@) +m,d) —Ip(Ry, O(a) +m,d). (3.69) 
After tedious transformations we obtain the following final expressions for the estimates of 
R: 
” we (x,y Rus Ld), (3.70) 


a 


1% 2 
epee B x4 Dy (x, Re, Ru, 2,d)dx — R”?, (3.71) 
a 


where 
5] 
p= | x4 "Tw (x,Rp,Ry,0,d) dx. (3.72) 
Jay 
The equation for the determination of the lower Bayes confidence limit has the torm 
a 
i x4 wy (x, R},Ru0,d) dx— By =0. (3.73) 
ay 

The calculations with the help of the formulas (3.70)—(3.73) require numerical methods of 


integration and solution of transcendental equations. 


Example 3.3. The results of testing are represented by the following relative operating 
time: v* = (2.7), v= (1.9; 3.3; 249391; 2.8; |b 67224; SANs: 2159310) Mies tow 
priori, that the TTF is distributed uniformly in the interval (0.9: 1. and parameter q@ is in 
the interval [1; 1.8]. Calculations by formula (3.70) (3.73) with y — 0.9 enable us to obtain 
R* = 0.9666, Og. = 0.0202, R59 = 0.9291. 


In the case when the value of the parameter @ is given exactly (not in the Bayes sense). the 
formulas for the TTF estimates are simplified substantially. For example. for the posterior 
p.d.f. of the parameter r, the followingrelation holds: 

h(r|t) ~h(r)r® In? r. 
One can easily obtain the expressions for the TTF Bayes estimates from the relations 
(3.70)—(3.73) if one multiplies their integrands by the delta-function, taking on the val- 


ues in all points but the given value a. Using the filter property of the delta-function, we 


obtain 
A * _ lw(a, Ry, Ry, 1, d) 
R Se eee aes 
~ Iw (0,Rp,R,,0,d)? Coley 
_ lw(a,R y d) _ A 
2 W rh Usss * 
Fy (@,Ry,Ry,0,d) — ee 
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The equation for R’, has the following form: 
Iw (@,R},Ry0,d) — Ylw(a,Re,R,0,d) =0. (3.76) 


Example 3.4. The article has been tested 13 times under the same conditions; relative 
operating times, fixed in the testing, coincide with those in Example 3.3. A priori TTF R is 
distributed uniformly in the interval (0.9; 1]. The value of the parameter @ is given exactly: 
a = 1.8. The calculations by formulas (3.74)-(3.76) give R* = 0.9766, Op. = 0.0163, 
Rj9 = 0.9546. 


We have carried out numerous calculations by formulas (3.70)-(3.76), in particular, for 
the samples 1, 2, and 3, mentioned in the previous paragraph. They have shown that we 
meet the same conformities for the TTF estimates as in the case of the linearly increasing 
intensity function. 

In conclusion, we consider the model of the Weibull distribution in connection with the 
frequently encountered binomial scheme of testing. This scheme may be reduced to the 
NC-plan, if one assumes that all empirical data coincide with the required time of function- 
ing t9 : t] =% (i= 1,...,d), t; =t (j = 1,...,k). For the posterior p.d-f., the following 


relation holds: 
h(r,a| t) ~h(r,@) ar" In? r. 


Following the usual scheme of the Bayes procedure for the case of a priori independent 


parameters & and r we obtain 


(05) Ry Ry 
i ath(a)da ‘| rh(r)r"n? rdr / P+1 n(n) Ind rdr 
Re 


* a / R 
a (3.77) 
i ath(a)da | h(r)r"\n? rdr / rh(r) In? rdr 
ay Re Re 


i.e., the Bayes posterior TTF estimate is independent of the interval of values of the param- 
eter @. The final expressions for the Bayes estimates with a uniform /(r) in the interval 
[R;,R,| coincide with the expressions (3.74)—(3.76), if one substitutes into them @ = n. 

The same conclusion may be drawn for the model with a linearly increasing intensity func- 
tion, considered in the previous paragraph. Namely,for v? = v, = | and a priori independent 


parameters z and r, from (3.54) and (3.55) it follows 


d 
h(r,z|t)~h(z =.) h(r)r™ In? r, 
(nz] 7) ~ate) (25) me 
i.e., a prior density may be represented as a product of two functions each of which depends 
on z and r respectively. Consequently, for the Bayes pointwise TTF estimate the relation 


(3.77) holds. 
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The generalization of the considered peculiarities enables us to draw the following con- 
clusion: the Bayes estimates for the binomial testing scheme are non-parametrical for the 
class of all models with linear and power intensity functions (of the form f@ ), if the model 


parameters are a priori independent. 


3.6 The Bayes estimate of time to failure probability from accelerated life tests 


At present for the experimental testing of many technical devices authors use methods of 
accelerated life tests. The detailed analysis and modern approach to the theory of accel- 
erated life tests is given in [122]. The essence of these methods may be interpreted as 
follows: we reduce the testing time due to the increasing severity of operating conditions. 
In practice we often meet a situation when it’s impossible to find the relationships between 
the operating conditions and reliability characteristics, since the operating conditions may 
have a random nature. 

In such a situation it will be useful to apply the Bayes approach which gives us the pos- 
sibility to make decisions under uncertain conditions which are considered the best with 
respect to minimizing a certain specific loss function (see the work [199]). Unfortunately. 
representation of a priori information is chosen in an arbitrary form in an awkward form. 
We represent the procedure of probability for TTF estimating. proposed in {221]. The tests 
are carried out by the scheme of step-loading [122]. It is assumed that testing conditions 
have a random nature and a priori information has a comparatively simple representation. 
Suppose that during the process of accelerated life tests we have to find the TTF estimate for 
some time interval t: R = R(t) = P{¢ >1}. The article is functioning under some nominal 
conditions co. Since the test will be carried out under some severe operating conditions. 


we rewrite the expression for the R(r) in the form 


WRU £0) = hea) >t: (3.78) 


where €(€) is a random period of trouble-free time under the nominal mode. Here, and 
further on, the notion of a mode is interpreted as the set of parameters characterizing con- 
ditions and type in which the device is functional. The formulation and solution of this 


problem can be solved subject to certain assumptions given below: 


1) During the testing the scheme of step-loading is realized. This means that we are given 
some longest testing time T and the segment [0,7] is divided into m+ 1 nonintersected 
segments [tj = [sj,5; +1), 7 =0,1,....m. This partition is performed on the stage of 


preliminary investigating tests. Each testing article is functions in the nominal mode Ep 


The Methods of Parametric Bayes Estimation Based on Censored Samples 73 


independently from the others. After this, if the failure doesn’t occur, a switching occurs 
onto some more severe mode €) and so on. Each interval [jis associated with its own mode 
£€;. It is very important that the choice of indicated modes lacks uniqueness. 

We may only each successive mode is more severe than the previous one. For the descrip- 
tion of this fact we introduce the notation €; > €;_1. It is assumed that the tests may finish 
as failures or as standstills, which in turn may be random or determined after the time 
T. Bearing in mind the technical characteristics of the tests, we can reduce them to the 


NC-plan, resulting in the sample t = {t*,t}, where 
if =i tout = (fie... nee. a + een. 


2) The failure rate function A (f)is assumed to be piecewise constant so that A(t) = Aj; = 
const: for? CpG = 1, 2,..4 m). In other words, the failure rate function depends on the 
testing mode: A(r)A(e(r)). 

Suppose that more severe testing conditions uniquely imply the increasing of failure rate, 
Pemine condition £; = 6-jimplies A(€;) > A(€;=1) or ApS Aj_1 (f = 1, 2,...,7). 

3) The prior distribution h(ro) for TTF at some instant to is known before the testing. 
Further on we will mainly use, as basic, a uniform prior distribution of the parameter Ro = 
Ro(to, €) in the interval [Rz, R,]. 

The assumptions we have formulated above let us solve the problem of estimation of the 
index R = R(t, €) in a classical Bayes setting. We introduce the parameterization in terms 
of the vector A = (Ag,A),..., Am), whose number of components is the same as the number 
of modes. We apply the standard Bayes procedure for the problem solution step by step: 
a prior distribution density A(A) of the given vector, obtaining of the likelihood function 
f(A | tT) and posterior distribution A(A | T), obtaining of the estimates Rae R,,, with the 
help of it. 

We seek the density of a prior distribution h(A) in the form 


h(A) = ho(Ao)hi (At | Ao) -*:Am(Amn | Ao, +++: Am—1)) (3.79) 


where h;(A; | Ap,...,A; 1) is the conditional prior probability of the parameter A; under 


the condition ow, hye) . We define the marginal prior p.d.f. by use of a uniform 
prior distribution of the index Ro € [Ry,R,,| and dependence Ro = exp(—Apjo): 
FG) cA Ay < AE, (3.80) 
Ry a Ry 


where Aj = —InR,/to, Ag = —InRe/to. 
The conditional prior p.d.f. A(A; | Ao,...,A; -1) is defined so that each multiplier of a prior 


p.d.f. (3.79) belongs to the same family of densities, namely, to the truncated potential 
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family. This assumption is similar to another one having a more distinct physical nature: a 
TTE at the moment fo for the mode €, doesn’t exceed a TTF at the same moment for the 
mode €; 1, i.c.. R(t. €,) € [O.R(to.€, 1)| forall yj =1.2..... m. Besides. the index R(t. €,} 


is distributed uniformly in the mentioned interval. Using this assumption itis easy to obtain 


hj(Aj | Ao,---.Aj-1) = toexp[—(Aj — Aj-1)to}.- 


Ape A; i, 2 eee (3.81) 
Substituting the expressions (3.80) and (3.81) into (3.79). after evident transformations we 
obtain 
i 
h(a) = —~—e **", AED, (3.82) 
(A) R, oR 
where domain D is defined by the chain of inequalities A, < Ay < A. An SAL... Am 1 < 


Am. As follows from (3.82), a prior p.d.f. depends explicitly only on Ay. However, hi A ) 
is a function of all parameters because this dependence is expressed by the form of the 
domain D. 

To find the likelihood function é(A | tT), we use (3.21). rewritten in terms of intensity func- 


tion A(r) and resource function A(r). Using the function 


l, tepp=lssies)): 
n= 4 J [sj 1,9) 
0, hep; 


for A(t) we find 


ny 


A(t) = ¥° Ajp;(r) (3.83) 
jel 


After integration of the intensity function, we obtain 


m 


j-! 
A(t) = ¥ p;(r) x Abr HA; (t 2) (3.84) 
}/=0 r=0 


Substitution of (3.83) and (3.84) into (3.21) yields 
m nom ji 
CA Lie erat t) [J p(s; JA, aap dL Px ity) > aa mayne) | >. GRR 
atl = r=0 
We proceed to rewrite the expression (3.85) in a more suitable form andderive the sufficient 
statistics. 
Let mj; be the number of clements of the sample Tt belonging to the interval t,. We denote 
these elements by a ,t=1,2,...,m;. Next we'll substitute aah successively into (3.84) 


and perform the summation over all indices i for all m segments. It yields 


nom Heal m 
ys Y pit) » ea) = pPe hy G. (3.86) 
i—0 
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where 
mj : 
kj =njAj+y) lee =) ; 
i=l 
yey neti: 
PHN Aessest—l, Pen =O? Aj = Sj —S;. 


The quantity n; determines the number of sample articles which don’t fail after the testing 
in the mode j. The statistic k; has the sense of a full lifetime during the testing in the mode 
i 

Analogously, if one denotes by d; the number of failures observed during the testing in the 
mode /, then 

d [m m 
I] Eos yi =[]4/’. 
JP! Ee ay 

With the help of (3.86) and (3.87) we can rewnite the likelihood function (3.85) in the 


following form: 


e(A | t) =c(t) TA exp (- a 2 (3.87) 
j=0 j=0 


As can be seen from (3.88), the sufficient statistic for this case is formed by the quantities 
dj, a, i ams ki, Koa. ss Km: 


In accordance with the Bayes theorem for the posterior p.d.f. of the vector A, we have 


m m-1 
h(a | t) ~ ee exp - y Ajkj+Am(km +to)|, 4 €D. (3.88) 
j=0 j=0 


Since the desired index R = R(t, €) depends only on Ao, for the obtaining of Bayes esti- 
mates of the index R we need to know the marginal posterior p.d.f. (Ao | t). To this end, 
we’ll integrate the relation (3.89) over the parameters A), Az,..., Am, where the integration 


domain is determined by the domain D, 
ho(do|t)~ fp fv f W(A| t)dai dda---ddm. 
) H m—l 


Having performed the integration and some ambiguous transformations, we can obtain the 


following (the most simple) expression for fg (Ao | T): 


h(Ao | t) ~ Ag” = Sm(Ao) exp[—Ao(Xo + t0)] (3.89) 
where 
Din=Nin m , — Nj) 
Sy = D\—No Cig ee 
(Ao) = Ae D> Ag ul (Xj + to)ut! 
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and 


X;= Yk Bia, S;=d- a Naas 
i=0 i=0 i=0 
where the symbol k!'denotes the operation k!/(k — 1)!. We find the estimates R* and Gp 
from the condition R = exp(—A(€)r) — exp( -Apr) using the quadratic loss function. 
We are starting from the expressions 


Te 
pe [ eM hig(Ay | t)ddo. 


J 


Ary 


) 
where Aj = —1nR,/to, Ay = —InRz/to. 
The final expressions for R* and Og. may be written with the help of the function of the 


reduced argument v = t/to as 


Dm—Nm Do—No (Do —No)é (D, — N,){ 
mi(¥) Ze ) d pees ene ae 
~ ore ing SR ee link |?) , 0=0.1.2. (3.90) 


where @, = X;/to, P= ig thy +--+ +h. 
Now 


A Ami (v) 2 Hni2(v) Ew) 
Ra , OF = —R**. (3.91) 
Hm, (Vv) ‘. Any) 


We need to solve the following equation with respect to. in order to find the lower Bayes 


y confidence limit 
Jj, Fo(2o | #)ddo = 1 


after then Ry = exp(—xr). The equation for R} takes on the form 


Din-—Nmn Dy—No m Dea N, \(is) 
XE (m ar 1) ie eae 
im=0 in=0 s=0 (Qs a i) , 
” Po aie! 
x R® "| InRy|4 1 — Ry” |InRy — YHmno(v) =0 (3.92) 
As follows from the relations (3.91) -(3.93), the set of failures do. d)..... dm. observed in 
the time intervals with unchangeable mode and dimensionless parameters @. @)..... On. 


generates the sufficient Bayes statistic. The parameter @; has a nature of respective (with 


respect to fo) operating time intesting which was fixed in the intervals Wj. Mj + 1..... bm. 
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Consider the reduction of the formulas (3.91)-(3.93) to the “destruction” method [122] 
which is a particular case of the step-loading method. It is characterized by two modes: 
nominal and severe. In the expressions (3.91)—(3.93) we have to put m = 1. The algorithm 


takes on a simpler form, in particular, the function Hj ¢(v) is written as 


i — i)V) dq? 
i 
H 1 __ 
me = a (@ +1) 
- ee lin, |@-*-4 Sjerran jinR|*-*~) (3,93) 


The equation for Ry for m = 1 is also substantially simplified: 


oy, dae (d—i)Y d\) 
== a (@ +1) 


x (aetiinie ve Ra Inks 


d—i-j 
) — YH\o(v) = 0. (3.94) 


Example 3.5. Consider the case of having 10 devices which are being tested. It is a priori 
known that the TTF of each device during the period of 100 hours is not less than 0.8. We 
have to estimate a TTF of the article being in a nominal functioning period of 140 hours. 
The tests are carried out by the “destruction” scheme. The mode switches after 100 hours 
of functioning. The limit testing time is 160 hours. The following operating times have 
been observed (in hours): 135, 142, 148, 135, 140, 150, 139, 144, 148, and 136, where 
each testing has ended by failure. The special computation algorithm based on formulas 
(3.92), (3.93), and (3.94) has been used. The estimates we have obtained are the following: 
R* = 0.9055, og- = 0.07054, Ri 5 = 0.8379. 


Chapter 4 


Nonparametric Bayes Estimation 


4.1 Nonparametric Bayes estimates, based on Dirichlet processes 


For a long time there were a lot of unsuccessful efforts directed toward the solution of many 
nonparametric problems with the help of the Bayes approach. This can be explained mainly 
by difficulties a researcher encounter, when he attempts to find a suitable prior distribution, 
determined on a sample space. Such a distribution in nonparametric problems is chosen 
in the form of a set of probability distributions on the given sample space. The first work 
in this field where some progress has been achieved belongs to Ferguson [80]. Ferguson 


formulated the requirements which must be imposed on a prior distribution: 


1) The support of a prior distribution must be large with respect to some suitable topology 
of a space of probability distributions, defined on the sample space; 
2) The posterior distribution under the given sample of observations from the real distri- 


bution of probabilities must have as simple a form as possible. 


These properties are contradictory, bearing in mind the fact that each of them can be found 
from each other. In the work [80] a class of prior distributions was proposed, named Dirich- 
let processes, which not only possess the first property but also satisfy the second one. 
Exactly such a choice was offered, because a prior distribution of a random probability 
measure appears to be also a Dirichlet process. Another argument in favor of using the 
Dirichlet distribution in practical applications is explained by the fact that this distribution 
is a good approximation of many parametric probability distributions. Special attention is 
paid to this question in the works by Dalal [51] and Hall [52]. This distribution appears also 
in problems dealing with order statistics [266]. In the Bayes parametric theory it is used as 
a conjugate with the sampling likelihood kernel for the parameters of a multinomial distri- 


bution [63]. Below we give the definition of the Dirichlet distribution and formulate (from 
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a practical point-of-view) some of its important properties. 


4.1.1 Definition of the Dirichlet process 


Denote by [(a@. B) a gamma probability distribution with the shape parameter @ 2 0 and 
scalar parameter B > 0. For @ > 0 this distribution has the probability density 

F(z;,a, B) = Rape tani (4.1) 
where /s(z) is the indicator function of the set S identically equal to unity for all - < S and 
equal to zero otherwise. 
Let 2). 22.....2x be independent random variables. <, ~ F(a@,.1) where @, 2 0 tor all j 
and a, > 0 for some j. The Dirichlet distribution with the parameters a. @2..... Ole. 
denoted further on by D(Q).00..... Ox). is determined as the distribution of the variables 


Y,,¥Y2,...,¥x, defined in the following way: 


k 
Fj] Sipe iE Maaoael 
Note that if some a; - 0, then the cons eeaias Y, also degenerates to zero. Provided that 
aj > 0 for all j, (k — 1)-dimensional distribution of the variables ¥,..... yi ) is absolutely 
continuous with probability density 


(a, +-:-+Qx) cal ee ee as 
FO VE Ok) = Tia) tag) IT»; ( 7 E»] iii. hae. 


where S is the following set: 


Kemal 
{Ore yj 20, Eo<ih 
j=l 


For k = 2, the expression (4.2) is transformed into the beta probability distribution which 
will be denoted by Be( a, @). 


The use of the Dirichlet distribution is based on the following properties: 


Property 4.1. /f (Y|..... Mele: 1D) oiival Fils Iino ane r, are some integer numbers, satisfying 
the inequalityO <r) < 12 <---<nm=k, then 


Sai ey To) ene aaa 


i=] i=r+l t=r¢_, +1 


Property 4.2. /fa prior probability distribution of the variables ¥,..... Yx is D(ay..... OK) 
and if P{X = j|Y%,...,.¥«} =Y; is almost surely for j = 1,2,...,k, then the posterior 
probability distribution of the variables Y,..... Yn for X = j ts the Dirichlet distribution 


Dia <3 on where of!) = Q; asi # j and al!) = O,+1 asi= yj. 


i 
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Further, we need the following moments of the Dirichlet distribution: 


EW) ==, 
2 (a; + 1) 
Te a(a+1)° 
and 
OQ; Nees 
Eh ieee if j, 


where @ = ne Oj. 

Now we shall give the definition of the Dirichlet process. Let Q be a sample space and Y 
be a o-algebra of this space. The probability measure P, defined on (Q,./), we consider 
to be random in the Bayes sense and later will be called a stochastic process. Note that, in 
contrast to the parametric Bayes estimation, it is not assumed that the measure P belongs to 
some parametric family. The nonparametric Bayes approach, in essence, may be construed 
as follows: for any finite partition from the space Q, we should determine some capasive 
prior distribution on the parametric space which is determined by this partition. 


In this sense, a measurable partition of the space Q is a sequence of sets (B,,Bz,...,Bx) 
such that B; € &@ for all i, B}0B; 4 0/ for alli ¥ j and, finally, U B; =. The probabilities 
P{B,}, P{Bo},...,P{Bx} are random; the problem is to as a prior distribution for 
these probabilities for any k > 1. 


Definition 4.1. Let @ be a nonnegative finitely-additive measure on (Q,). The random 
measure P on (Q,.@) is called a Dirichlet process on (Q,L) with the parameter q@ if for 
each k = 1, 2,..., and measurable partition (B),...,Bx) of the set Q, the distribution of the 
random variables P{B,},..., P{Bx} is a Dirichlet distribution D(a@(B,),...,@(Bx)). 


In the work [80] with the help of the uniqueness property of the Dirichlet process the 
fulfilment of Kolmogorov consistency conditions were proven. It is easy to check that the 
properties of the random probability measure P are closely connected with those of the 
process parameter @. In particular,if a@(A) = 0, then P{A} = 0 with probability equal to 
one. Similarly, if @(A) > 0 then P{A} > 0 with probability equal to unity. Besides, 
a(A 

E|P{A}] = ay (4.3) 
To use the Dirichlet process, we have to find its posterior distribution, i.e. the conditional 
distribution of the Dirichlet process under the given sample. At first we introduce a notion 


of a sample from a random probability distribution. 
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Definition 4.2. Suppose P is a random probability measure on (Q..2). A set X)..... Neg 


is called a sample of size n from P, if for any m = 1,2,... and measurable sets 


POG €C\,....Xn © Gol PlAm), PLC tang Gn) eens (4.4) 
eS) 
almost surely. See Ferguson [80]. 


In other words, X;,...,X, is a sample of size n from the distribution P. if for 
the data P{C\},...,P{C,} the events {X; € Ci},...,{Xn € C,} are independent 
from the other events of the process as well as mutually independent. so that 
P{X; €C; | P{Ci},...,P{Cr}} + P{C;} for all j = 1. 2.....2. This definition determines 
a joint distribution of the variables X)..... X RAAT... P{A»} as soon as we are given a 


distribution for the process, therefore 
P{X,;€C),...,Xp Gu Play 1, P An Soak 


can be obtained by integration of the expression (4.4) with respect to the joint distribution 
P{A;},...,P{Am}s PAC) }, .+,P1{C,} overthe seti(0, y;| x --x [Gin] < .-- 10m]. 
Directly from the given definition and properties of the Dirichlet process (wo important 


statements follow: 


1) If X is a sample of unit size from the Dirichlet process on (Q..2) with the parameter 


a, then for A € Y we have 


P{X € A} = a@(A)/a(Q). 


2) Under the same assumptions, for any measurable partition By..... Bx of the space Q we 
have 
k 
a(B;MA) ‘ 
P{X EA, PIB} <i... PIBK} Sep =Y olka (» —_ ee ) 
a; NCR 
where D (v1 oe nia,” ee a!) is a Dirichlet distribution function, oe a Bat 


i# jand a") ~ (Bj) + iti = 7. Now we are ready to prove, using these statements, 
the theorem of a posterior distribution of the Dirichlet process which shows that the 
posterior distribution has the same form as the prior one, with the parameters depending 
on the sample. Note, if dy is a measure on (Q.), assigning a unit mass to the point 


X, i.e., dy (A) = | for X € A and dy(A) = 0 for X ¢ A. then the following statement is 
valid. 
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Theorem 4.1. Let P be a Dirichlet process on (Q,YL) with the parameter a and X\,...,Xp 
is a sample of volume n from P. Then the conditional distribution of the process P under 


the given sample is a Dirichlet process with the parameter &@ + ¥""_, 6x,. 


Theorem 4.1.1 is the main result of the work [80] which enables us to solve some practical 
problems. This theorem gives us a method of obtaining the Bayes decision rule firstly 
when there is no sample available (n = 0), n and secondly, by further reduction, replacing 


the parameter @ by @ + Y_, dx,, when we have a sample X),...,Xn. 


4.2 Some nonparametric estimators 


We give below a number of examples illustrating the use of the Dirichlet process. As a 
sample space, we choose the real axis R! or some part of it, for example, a positive semi 
axis R™ = {0,cc). & is used as o-algebra of all Borel sets. For the solution of practical 
problems, one has to define at first the metric @ which reflects a priori information about 
the model we have learned. Throughout what follows, a is a finite nonnegative o-additive 
metric on (R', B) or on (R*,B). 


Example 4.1 (The estimate of a cumulative distribution function and TTF). Suppose 
at first that we have to estimate a c.d.f of a random variable F(t) = P{(—9.r)} with a 
quadratic loss function. If P is a Dirichlet process, then F(t) ~ Be(a@(—<,1]), (@((t,°°)) 
for each t. The Bayes risk for the problem without a sample is minimized by a choice of 
such an estimate F*(t) for each r that the quantity E[(F(t) — F(t))’] is minimal. This is 
accomplished if one chooses as F* the quantity E[F(r)]. Thus, the Bayes decision rule for 
the problem without a sample is 

F*(t) = F(t) = EF]. 
In accordance with (4.3), 

Fo(t) = ae 


The expression (4.5) with the help of the earlier chosen metric a gives us a priori informa- 


(4.5) 


tion about the form of the unknown distribution F(t). 


Starting with Theorem 4.1.1, analogous to the relation (4.5) for the sample of volume n, we 
have the following decision rule: 


FF ltepren nag hi= 


ar((—9,1]) + UF Se, ((-r]) 
a(R!)+n 


PaFo(t) + (1 — pa) Falt | x1,---,%n), (4.6) 


II 
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where 
a(R!) 
Pas GRD een 


re ' 
FAG teen) = > y &,((—-, t]) 
i=) 


is the empirical distribution function. 

Therefore, the Bayes decision rule (4.6) is a blend of a prion information about the form 
of F(t) and the empirical distribution function with the corresponding weights p, and 
(1 — pn). If @(R!) is large, in comparison with n, then the observations are given a small 
weight. Provided that @(R!) is small in comparison with n, then a small weight is given 
to a prior conjecture about the form of F(r)). a(R!) can be interpreted as a correctness 
measure of a prior conjecture about the form of F(t) expressed as a number of the units 
of measurement. It should be noted that whatever a true distribution function may be. the 
Bayes estimate (4.6) converges to it almost surely. Thisfollows from the fact that p, — 0 
as n — ©, 

Suppose now that we have to estimate the probability of a time-to-failure R(t) = 1 — Fir) 
at some time t dealing with the outcomes of independent tests with the fixed failure time. 
All arguments mentioned above remain valid, if one replaces R! by R7 since? < 0.00). As 


a result we obtain 
R*(t) = pnRo(t) + (1 +0) [ — mt) 3 (4.7) 


where Ro(t) is a priori information about TTF, m(r) is the number of objects failed by 
time f. 

As can be seen from formula (4.7), the value of the Bayes estimate is strongly subjected to 
a(R! ). If, for example, one assumes that a mean time to first failure follows a priori the 


exponential distribution with the parameter A and puts 
a((O.1]) =e", 


hence a@(R*) = 1, and, consequently 


R= erat (1-20). 


n+1 n+ 


It is interesting to note that in the case of failure in one trial, the a priori TTF estimate 
should be reduced twice; in case of two failures in two trials-three times, etc. Clearly, the 


significance of a prior estimate is very small in this case. 
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Example 4.2 (The Bayes estimate of quantiles). A quantile of a distribution F(t) = 
P{(—oo,t]} of the probability g, denoted by f,, is introduced with the help of a probability 


measure P in the following manner: 
P{ (—20,tq)} <q < P{(—-,t4}}. 


It is easy to verify that for 0 < q < | a q-quantile is unique with the probability equal to 
unity. Thus, ft, is a well-defined random variable. Ferguson [80], considered the problem 


of estimating f, with a loss function 


Ltq,fq) = iF eas bee (4.8) 
(l—p)(%j-t%), tq <% 

for some p (0 < p < 1). The variable p plays the role of a weight coefficient. In particular, 

for p= t we have L(tg,fy) = : \tq = dil Due to this circumstance a loss function of the 

form (4.8) can be interpreted as a generalization of the broadly used loss function having 

a type of absolute error. The distribution of the random variable t, can be found from the 

condition F(t) ~ Be(a((—-,t]), a@((t,0c))). We have 


Pig= P(e) 4) — a acon” lz) wetaz, (4.9) 
where 
a=a@(R') and u= ran = Fo(t). 


According to Ferguson [80], any p-quantile of the distribution r, is a Bayes estimate of t, 
with a loss function of the form (4.8). In order to find a p-quantile of the distribution of the 
random variable t,, the expression (4.9) must be equated to p and solved with respect to r: 
: (A) ua—} (1—u)a-1 
SS ee ie 2. 4.10) 
ins a P ( 

Consider the relation (4.10) as an equation with respect to u and denote by u(p,q,a(R')) 
the unique root of this equation. Then the Bayes estimate t; in the problem without a 
sample is determined with the help of the equation 
a ((-»,43) 


aa (4.11) 


u(p,q,a(R')) = 


wip gc) =i). 
Thus, the Bayes estimate of the quantile 4, in absence of a sample is a quantile of the 
distribution Fo(t) of the probability «(p,q,a(R')) obtained by itself from the equation 
(4.10). 
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For the sample a),....%, the Bayes estimate 1) in accordance with (4.11) is determined 


from the equation 


u(p,q,a(R')+n) = 


i.c., in the given case /7 is a quantile of the probability u(p.q. a(R!) =n) of the distribution 
2) ne ‘,) defined by the expression (4.6). For the practical use of the given scheme 
it is desirable to have tables for the function w(p.g.@) which may be obtained from the 
tables of the incomplete beta-function. 

The developments mentioned above have very serious limitations: the quantity P. con- 
sidered as a Dirichlet stochastic process, is discrete with probability one. This can be 
explained as follows: dealing with samples from the Dirichlet process one can expect the 
appearance of the observation which exactly equals each other. In the proposed examples 
the possibility of sample elements coinciding doesn’t play an intrinsic role. At the same 
time there exists a problem in which this fact is of great importance. One such problem 
is described by Ferguson. The problem is to verify the hypothesis Hp. giving the fact that 
a distribution on [0.1] is uniform. If one chooses as an alternate hypothesis the Dirichlet 
process with the parameter @, of having a uniform distribution on |0. |. and given a sample 
of volume n > 2, then the unique nontrivial nonrandomized Bayes decision rule requires us 
to reject the hypothesis Ho if and only if two or more observations are equal to each other. 
In validity it is not something like the verifying of the hypothesis that the distribution is 


continuous against the alternative hypothesis that it is discrete. 


4.2.1 Further development of the Ferguson theory 


The work by Ferguson cited above has initiated numerous investigations having both a 
theoretical and applied influence in the field of nonparametrig Bayes estimates which uses 
prior Dirichlet processes. The most interesting theoretical work touching upon this field 
belongs to Yamato [269]. He considers the relationship between the nonparametric Bayes 
estimates, based on the Dirichlet process, with U-statistics [266]. Zaks [272] introduced 
the concept of the estimable parameter. A parameter 6(P) is called estimable if it has an 
unbiased estimate, i.e, if there exists such a statistic @(x),...,x,) such that 
‘ nh 
@(P) = f alvin) TJ 4P(a. 
_ 1] 
where Q” = Q x --- x Q. Degree of the estimable functional @(P) is called the minimum 


size of a sample for which there exists an unbiased estimate of this functional. It is clear 
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that the mean, considered as parameter, has first degree, and the variance second degree. 
Ferguson [80] deals as a rule, with first degree and, sometimes, with second degree param- 
eters. Yamato [269] obtained nonparametric Bayes estimates of the parameters having the 
second and third degree. Investigation of the dependence between the Bayes estimates and 
U-statistics is not fortuitous. The point is that U-statistics in the class of unbiased estimates 
of the parameter 6(P) with the given volume of a sample possesses the minimal variance. 
Denote by 0, the k-degree parameter which admits an estimate in the sense of [272]. The 
main result of the work [269] lies in the following. Suppose that x;,...,x, is a sample from 
the distribution F ~ D(a), where @ is a finite nonnegative measure on (Q,#). Then the 


Bayes estimate of the parameter 


03 = | ff as(x,y,2)dF (x)aF dF (2), 
where a(-) is a measurable real function, symmetric with respect to the arguments x, y, z 


and possessing an absolute moment of the first order, is defined by the expression 


Re [a(Q) +n] se ; 
05 = rg OO ff ence naarsonars oars 
3[a(Q) +n] 
*Ta(Q)4n+ la a(Q)+n+2] [focxary (x)dF*(y) 
s * 
SF CCNESESI CORSE ieee Le (4.12) 
where 
Fr(-) = PaFo(:)+(1—Pn)Fn(); Pa = oe 


Fo(-) and F,,(.) are correspondingly a prior and empirical distribution functions. 


For the estimable functional of the second degree, 


6) = | as(x,y)dF(x)aF(), 


under the same assumptions, the following Bayes estimate is obtained: 


6; = — x, y)dFo(x)d Fo(y) 


a(Q)+n+1 
+ pal (I= pa) farts x)dR(x) + 5 app? @2{x;,X;) 
=" i=) j= 
a Pp foe eye) = (1 ip) We atin) (4.13) 
G(Q)+n+1)"" ‘ n | 


As can be seen from the expressions (4.12) and (4.13), the values of the estimates 6; and 


6; with a fixed sample x),...,X, are determined by a choice of a prior measure a. The last, 
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as was mentioned above, is uniquely determined in the case when the value @(Q) is given 
and there exists a priori information about the distribution function Fo (x). Itis interesting 
to learn the behavior of the estimates as @ — 0. This case. it seems. can be considered 
in the absence of a priori information. The functions a;(x.y....) are vanishing if at least 
two arguments are equal. Under these conditions the Bayes estimates 6; and @3 have. as 


a — 0, the form 


67, = a(x (4.14) 
a = >> ae) 

and 
63; = = ——____ Ay 3G X 58): (4.15) 


is ee 


i< jcok<n 
The Bayes estimates we have obtained are similar to U-statistics for which there are well- 
known results, that is, 


(th = Ace omy p»> @9(xi,X}); 


<i<j<n 


and 


1 (XiveoMapacdinedl: 


i<j<ken 
Thus, we have the following finite relations tor the Bayes estimates & and U-statistics: 
(n—1)(n— 2) 
(n+ 1)(n+ Ty 


ea F 
i pU2 and 4; = 


Using these relationships we may conclude that 65, converges to Uy as = ©, 
Consider two examples of nonparametric Bayes estimates for parameters admitting the 


second order estimate. 


Example 4.3 (Estimate of the square of the mean, 7”, for an unknown distribution F). 
If one puts a2(x,y) = xy, we obtain 6) ~~ m7. From the expression (4.13) immediately fol- 
lows 


~* (04 R! + ; 
pyr? — ay et >, frarw+i - Pr 


ate a(R) tnt) Pn [Pareto +(1- ps3] ; 


where x, = Dem It is ace to note that the corresponding U-statistic has form 


U2, = ———_~ = wee xxj= toad. 


Wier tec 
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Example 4.4 (Estimate of the variance of the distribution F). For a2(x,y) = (x- y)? /2 
we have 0) = o*, where s is mean-squared value of the distribution F. From the expressions 
(4.13) and (4.14) one obtains 


hae we \ [earn = (fare) | 


n fe 
+(1 —pr)y ==) =p,) ( [ xaro) x) ' (4.16) 


i=1 


As a@ — 0, we have 


1 n 
a Y (x1 - in)’. (4.17) 
=| 


The estimate (4.16) coincides with the estimate of the variance obtained by Ferguson [80]. 


65" — 


lI 


The U-statistic, corresponding to the Bayes estimate (4.17), is a well-known unbiased esti- 


mate of the variance 
if n 


ys (x; — a A 


al 


i= 
z n—| 


Further development of [80] can be found in the work by Susarla and Van Ryzin [246] in 
which a nonparametric Bayes TTF estimate R(t) = 1 — F(t) is obtained for F(t) ~ D(a) 
for censored data. Let, as in Chapter 3, t7 be failure moments (/ = 1, 2,...,), and 1; be 
censoring moments. Besides, during the experiment it is observed the minimal of men- 
tioned quantities: t; = min{r? .1;}. The sufficient statistic can be represented as a union of 
two vectors (T,6), where 6 = (6),...,6,), and 6; = 1 if t? <1), i.e., the failure is observed, 
and 6; = 0 otherwise. It is assumed that failure times and censoring times are mutually 
independent. Note that all Bayes decision rules are independent of the order of elements in 


the sample representation. Therefore, we can present a sample so that its first d elements 


T,---,%q arethe failure times and the last k elements Tq, 1),---, Tn) are censoring times. 
We denote, at last, by T441)..--+T/m) the different one from other elements of the set of the 
censoring moments Ty ,1,...,T,, and by A; is the number of censoring times equal to f T;. 


As a parameter of a prior Dirichlet process for the considered case is chosen a positive 
finite measure on (R‘,B), where R‘ = (0,0), and B is o-algebra of all Borel sets on 
R*. The expression for the posterior moments of a random variable R(t) = 1 — F(r) is 
obtained by following the work of Ferguson [80]. For ft € [te), Te one (a ea m and 
Ta) = 0, Tn+1 = 0%, we have 


: b=! ( a((tco))+s+N7(1) ry &([%j),29)) +5 +N (tj) 
Ra seo TL a(ltj.c2)) FS NE) — Ay 


s=0 
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where N,,,) is the number of elements of the sample 7 exceeding or equal u. N (u) is 
the number of clements which are strictly greater than u. Besides, asf < T,.) the in- 
ner product in the expression (4.18) is equal to one. The expression (4.18) enables us to 
write, without any difficulties, the pointwise TTF estimate R*(r) = E (R(t) | (t.6)) and the 


posterior variance E Cicata) | (t,6)| -R**(t). In particular, for t < [ty Tae 


G([t,o0)) +N (t) : a ([t,,.0))# N° (1; ) 


ga ees (4.18) 
a(R*)+n jade Of [frj2)) # WE (AQ) A, 


R*(t) 


We compare the Bayes estimate (4.19) with the corresponding Kaplan-Meier estimate [121] 
a= T —— 


felts 


aa 4.19 
n—-j+l ( ) 


where p(t) is the set on indices of the variational row t; < tT) <--- < t, composed of the 
sample t, such that t/ <1 and 7; is failure time. The comparison of the estimates (4.19) 
and (4.20) shows that the Bayes estimates is more preferable. First. the Kaplan-Meier 
estimate uses only information about the number of censoring times contained between 
the failure times. The Bayes estimate is all information contained in the sufficient statistic 
(t,5). Secondly, although both estimates (4.19) and (4.20) are piecewise- smooth and have 
finite increments at the failure points, the Bayes estimate in the time between failures is a 
decreasing function (because of the continuity of a prior measure @), the estimate (4.20) 
equal to some constant. Finally, if the last element of the variational row Tt, is a censoring 
time, in the interval {tj ,0c) the estimate (4.20) is undefined. 
The limit passing in the expression (4.19) as @ — 0 (that corresponds to a prior informa- 
tion) transforms it into the Kaplan-Meier estimate. In the case when such a coincidence is 
possible, the Kaplan—Meier estimate is written as 
N*(t) N*+(t))+a;]° 
Sos (t) | a) | i 
0 
0, (. 


1 


xt 


R(t) = (4.20) 


where /o(r) is the set of the first indices among the repeating elements of the sample Tt. 
satisfying the condition T <1. The formulas (4.20) and (4.21) give the same estimates as 
A; = | for all i, but the latter one is more general. 

The properties of nonparametric estimates having the type (4.18) for samples of large vol- 
ume are investigated by Susarla and Van Ryzin in [245-246]. We briefly formulate the main 
results in these works. Both these estimate are mean squared point wisely consistent of or- 
der o(n™') and strictly consistent of order o(n '/?/Inn). In addition to this, both estimates 


are asymptotically normal with the same variance. Hence, from the point-of-view of the 
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theory of large samples, we may conclude that nonparametric Bayes estimates, based on 
the Dirichlet process and Kaplan-Meier estimate, are equivalent. 

The comparison of these estimates for small size samples was done by Rai, Susarla and 
Van Ryzin [209]. Their work is interesting from the methodological point-of-view. It pro- 
poses one method of practical use of nonparametric Bayes estimates, based on the Dirichlet 
process. The choice of a prior measure @(-) plays the intrinsic role in this method. Once it 
was made, it remains only to apply formula (4.18). Let us introduce a real-valued function 
a(x) = @([x,00)). Then a priori information on TTF in accordance with (4.5) takes on the 


form 
Ro(t) = a(t)/a(0) = a(r)/B, where B = a(0), (4.21) 
and the Bayes estimate of TTF, R*(r) for the quadratic loss function under absence of 


censoring is rewritten as 


Rie) = eft) = ay halt), (4.22) 


B+n B+ 


where R,, is the cumulative TTF estimate, based on the sample of n independent obser- 
vations. Unfortunately, we cannot write the estimate of the type (4.23), substituting, for 
example, the Kaplan-Meier estimate instead of R,,(r). Nevertheless, for the choice of a 
prior measure @(-) it is advisable touse its interpretation, defined by the expression (4.22). 
Suppose, in accordance with a priori information, that the random mean functioning time 


is subjected to the exponential law with the parameter . Then, in view of (4.22) one has 


a(t) = Bexp (-=) ; (4.23) 
In the work {209] an estimate, which is based on the given measure @, is called reduced 
nonparametric Bayes estimate. Instead of exponential prior distribution for Fo(t), we might 
just as well have used the Weibull distribution, gamma-distribution, etc., and obtain the 
estimate which is more “narrow” as a result of the imposed restriction. In the work [209] the 
parameter p is estimated not with the help of a priori information but statistically: instead of 
m one substitutes into the function (4.24) its maximum likelihood estimate @ = Y?_, t;/d. 
where d is the number of noncensored observations. Then, with the help of (4.19) the 


Bayes TTF estimate may be written as 
6 
Bexp(-£)+N*() __ [Bexp(—4) +N*(n) +4) 
B+n ice | Bexp (-4) +Nt(t;) 


It should be noted that the estimate (4.25) is not, strictly speaking, a Bayes estimate. It 


R(t) = (4.24) 


should rather be called an empirical Bayes estimate because the parameter of a prior distri- 


bution jt is estimated with the help of empirical data. 
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In applying the estimate (4.25), an open problem is the value of B. In [209] the authors 


considered the mean-squared error of (4.23), that is, 


F : ; b 
E|(R() -R@))| = (a) (Ro(t) — R(t)? + ma —R(t)). (4.25) 


The first term in (4.26) determines the square of the bias, caused in the Bayes estimate by a 
priori information about the TTF: the second one is a variance of the unbiased estimateR ir). 
While n increases, the mean-squared error decreases, where 


lim (n~'B(n)) =0. 


t—reo 


and thus, B (v1) satisfies the condition B(m) = O(n®). for @ < 1. The authors of [209] make 
the following necessary assumption that both terms of the squared error (4.26) have the 
same order of smallness of n ’'. This is achieved when B = cy 1. where c is some constant 
value which may depend on the current value of f. In practical calculations of [209] the 
value c = | is assigned. 

Comparison of Bayes estimates with those of Kaplan-Meier for small samples has been 


studied [209] subject to the following criteria: 


a) As acriterion of comparison we choose a parametric estimate: 

b) We use two forms of modeling: exponential modeling. corresponding to the chosen 
prior measure (4.24) and beta modeling, which contradicts it. 

c) Modeling is carried out for different values of a theoretical mean U. and different per- 


centages of censoring. 


In Table 4.1 and Table 4.2 we give TTF values averaging over 200 samples. The table data 
enables us to draw the following conclusion: the Bayes estimate is better than the Kaplan- 
Meier estimate, moreover, this fact remains valid not only for the case when empirical 
data are in full accordance with a prior distribution, but also in the situation when they are 
contradicted. The deviation between the Kaplan-Meier and Bayes estimates increases with 
the increasing of the censoring percentage: moreover, while the first one removes from 
the parametric, the second estimate approaches to them. Application of a prior measure, 
based on more flexible distributions, for example on the Weibull distribution leads, most 
probably, to a better estimate, although with increasing computational complexity. 

The estimate analogous to (4.19) was found by Zehniwirth [273]. It is called a linear Bayes 
estimate and may be interpreted as a Kaplan-Meier estimate, constructed by blending a 


priori and experimental data. 
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Table 4.1 Comparison of TTF estimates under modeling of the exponential 
distribution. 


Censoring 


Estimate 
Percentage 


Parametric Bayes 
Kaplan—Meier 


Parametric Bayes 


Kaplan—Meier 


Parametric Bayes 
Kaplan—Meier 


Parametric Bayes 
Kaplan—Meier 


From a practical point-of-view, an important nonparametric Bayes estimate was found by 
Cambell and Hollander [36]. They considered the problem of defining a predicted inter- 


val containing the given number of future observations which is formulated as follows. 


[LSli sce eee X, be the initial sample from F ~ D(a), and y),...,y¥,_, be the sample of future 
observations. 
According to the definition of the statistic given in [36], a) (x1,...,Xn) and ag(x1,...,Xn) 


form 100% predicted interval (a;.a2) for M from N future observations, if the probability 
Py_n Of the event that at least M of N observations get into (a; ,a2) equals y. The probability 
y is called a prediction coefficient. A difference of a, and a2 from tolerant limits is that the 
last ones assume that we have to consider the whole set of future observations. For the case 
az = © we deal with a unilateral prediction interval. 

A good illustration for the considered problem may be the following technical example. 
A manufacturer of some technical device has a sample of values of the leading parameter 
X],X2.....X%5 for the set containing five such devices. The set of three such devices is put 
into operation. It is necessary to find the lower value of the leading parameter, guaranteed 
with a probability 0.9, which can be achieved for all three devices. In the given case, n = 5, 
N =3,M =3, y= 0.9. 


The solution for this problem is based on the following idea, traditional for Dirichlet pro- 


cesses: first we solve the problem in absence of empirical data; thereupon, using the prop- 
erty of conjugacy of the Dirichlet distribution, the solution is generalized for the case when 
n> 0. The resulting calculations, used for the solution of the problem, are derived from 


the following theoretical result of the work [36]. Suppose that for some future observations 
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Table 4.2. Comparison of TTF estimates under modeling of a gamma distribution. 


Censoring 


Estimate 
Percentage 


0 296 


0 158 () 535 @. igs 


Parametric Bayes 


: 0 156 (),348 Q.092 4) 208 

bi aii ous! | Ge | om | weer 
Oia | oa | os | A | 

Parametric Bayes 0.167 372 — — 

Eaieereenicicr 0.201 | oso | H113 | O283 

B 0.182 040% 0. 1s 6,338 

Parametric Bayes 0.184 saat? ee pane 

Kasomeiierc 0.232 | os7s | Wwe | teas 
Oligs |) Gees Galo | 


Parametric Bayes 


0191 
Kaplan—Meier 


0.315 


GR’ 
0701 


Y].....¥y random variables / = Iy, J = Jy. K = K, denote. correspondingly. the number 
of the sample elements not exceeding. greater than x but less or equal to y. and. finally, 
greater than y. In [36] it is proved that the quantities 7.J.K obey the composite Dirichlet 
distribution which may be written in the notations, introduced above, as 

N! a( (22, x])!" a(x. ¥])4iar((y,20)) 4 


PULLK) = 45.4)} = GN uN) * ar(RT) 


(4.26) 
where cl"! = c(c+1)-+-(c +m—1), and cl = 1, c[0] = 1. 
Consider at first the case of construction of a unilateral predicted 100 interval 1ay.ce}. 
To this end we put & — 0 and y = ©, It gives us a bivariate random variable 1/./ + whose 
marginal distribution J has the form 
Pen N! ” @r(( —00,.4])!) Jag ((x co 
(N—J)!j)! a(R!) 


The expression (4.28) determines the probability of the event that exactly 7 elements of the 


(4.27) 


sample y)......, are exceeding or equal tox. Consequently, the probability Py y is written 
asasum Py.w = P{J=M}+P{J=M+1}4---+P{J —N}. After this, for the obtaining 
of a in the absence of a sample, it is necessary to solve the equation 

NE (20, x) ar( (x, 00) 

d, (Mamah ail eR? a. — 
Here a@(-) has the sense of a prior measure, connected with a priori information about the 
c.d.f. Fo(x) by the relation @((—cox]) = BFo(x), where B = a(R!) has the sense of a 
weight significance of a prior distribution. In absence of data the estimate a). as follows 


from (4.29), is invariant with respect to the choice of. In the case when a Sample... Ni; 
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is given, one should replace a(-) in (4.29) by 


n 


a! (A) = a(A) + 5, (4), 


i=] 
where 6,,—1, if x; € A, otherwise 6, = 0. To find a bilateral 100% predicted interval (a), a2) 
we act analogously. In particular, the following equation holds: 


n N a’ ((x,y]) a! (R! — (x, y)) 
L,W-nh Rtn 


[N- Jj} 
(4.29) 


Moreover, among the values of a; = x, a7 = y we choose such two numbers, for which 
the interval length is minimal. The conclusion of the work [36] gives numerous examples 
illustrating the stability of the obtained estimates. 

In the work [53], Dalal and Phadia use a prior Dirichlet processes for the solution of the 
problem of estimating the relationship between random variables and verifying the cor- 
responding statistical hypotheses. They consider a bivariate distribution F (x,y) which is 
assumed to be a probabilitymeasure, subjected to a prior Dirichlet distribution D(q) in 
addition, a is nonzero measure on (R?..%). As a measure of dependence, a consistency 


coefficient A is used: 
1 
A= Ar = Pr{(X —X’')(Y —Y’) >O}+ 5 Pe {(X —X')(Y -¥') =, (4.30) 


where (X,Y) and (X’,Y’) are two independent observations from F (x,y). The coefficient 
A is connected with the often used t-parameter of Kenndal by the relation A = (t + 1)/2. 
The form of (4.31) assumes that random variables X and Y are not necessarily continuous. 
The problem of obtaining the Bayes estimate A* was solved in [53] in accordance with 
the Ferguson theory [80]. Suppose t and U are two sets in R* such T = {(x,y,x’,y’) : 
(x—x’)(y—y’) > O}, U = {(x,y,7,) : (x -x’)(y—y) = 0}. There upon we write (4.31) 


A= / (1 + stn] d[F(x,y)F(x,y’)], 


where /y and J, are the indicator functions of sets. Having chosen a quadratic loss function, 


we obtain the following Bayes estimate of the parameter A: 
1 
a / G 46 5!) dE|F(x,y)F(x,y’)]. (4.31) 


The expected value E is defined with respect to a prior distribution D(a). In particular, in 


absence of the testing data, 


ElF(x,y)F(x,y)] = a Fx, Wy) + Fo(x,y)Fo(x’,y), (4.32) 


B 
B+] B+ 
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ae 


where Fy (x,27,y,y’) = Fo(min(x,.),min(y,y’)), Fo. as previously, has the sense of a priori 
information about the bivariate distribution function, and B = @(R?). 
Substitution of the relation (4.33) into (4.32) allows us to write the following Bayes esti- 
mate of in the absence of empirical data: 
| 

= ea + 3B4+h y? (4.33) 
where Ay, is computed with the help of the formula (4.31) for the distribution Fo. If it 
is found that the quantities X, Y are a priori independent, A;,, = 1/2, and (4.34) implies 
A* = 1/2. In the case of existence of experimental data (x).¥))..... (xpova) therexpeéted 


value of (4.32) should be defined by the Dirichlet prior distribution with the parameter 
a’ = = 049 Bu 5) = (B+n)P*. 
ma 


Here P* is the posterior measure for which the bivariate distribution function has the form 


F* (x,y) = PnFo(x,y) + 1(1 — pn) Fn (x,y), 


where F(x, y) is the empirical distribution function, based 
on the sample (2;,)1),-.-;2%.¥n), and p, = B/(B +n). The resulting expression for the 


Bayes estimate is written in the following form: 


ae 2 | 
NG = pEaeet 1 [p2Ar, +2p,(1 a Pn)A (Fo. F,) te (1 = ga)” Aig | 5 : pm —— A (4.34) 
where 
1 n n 
Fi, ahh {ie oi ~ yee] [tar =a) = 3 j= ai} 
E15} 


A 12 
A(Fo.Fa) ==) Pry {(X —m)¥ -y/) > 0} + 5 5Pr {( - —x)(¥—y;) =0}. 


If we choose for Fo a bivariate normal distribution No (My). Mo.0). 02. ). then. for Wy) = bo = 


0, and 0; = 02 = 1, in accordance with [53], we obtain 


(4.35) 


Next, if one denotes by ®(x.¥) a function of the bivariate normal distribution 
N2(0,0,1,1,p) and B(x, y) = 1 — B(x, 00) — b(00, y) — B(x, y), it yields 


- Hi yin He = Mi Yer te 
® ® 
a Gra 7 a mate) (ae = = =) (4,36) 


ae 


The obtained relations allow us to find the estimate of A* for the chosen value B. 
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Note, that as n — oo, the Bayes estimate (4.35) approaches the sample size one. At the same 
time, for B = 0 (i.e., we have no a priori information), the expression (4.35) gives the usual 
nonparametric estimate of the coefficient A. 

In one of his works Ferguson [82] develops the theory based on Dirichlet processes in 
conformity to the successive estimation. In particular, he proposes procedures for obtaining 
nonparametric Bayes estimates of the cumulative distribution function and the mean. The 
essence of these procedures lies in the following. To each single trial is assigned some 
positive number c, interpreted as cost and having the same dimension as that of the loss 


function. The loss function has a quadratic form and is written as 
e(F,P) = | (F(x) —P(x)]°aW(2), 
R! 


where W(x) is a weight function on R!. After each testing, a statistician has to make a 
decision: whether he has to continue testing or to stop and choose the necessary estimate. 
As a criterion for making decisions, we use the total losses caused by the general procedure 
of estimating. These losses are added, on one hand, to the expected value of the loss 


function (Bayes risk), that is, 


n= 


] 
Banat Jy fn) Ai @)] aw), 


where Fr (x ‘) is a nonparametric Bayes estimate, based on a Dirichlet process (see the ex- 
pression (4.6)), B = a(R!). On the other hand, the cost of testing should be added to the 
total losses. 


Let, for example, in absence of a sample (n = 0), a Bayes estimate F* ~ Fo and losses be 


I 
Go= 5G [rR (1 — Fo) (x)dW. (4.37) 


If we carry out one testing, that is, we will obtain the value x), the total conditional losses 


(under the condition x; ) will be 


ct acs f IR A-Fylaw, 


B+2 
and their expected value will be equal: 
] 
gee 5 [Rt 1—F* aw| =c+ = aap {ea Fy)dW. (4.38) 
Here we used the relation E[F\] = Fo. For making the decision about the necessity of 


conducting the first testing, we have to compare the two quantities (4.38) and (4.39). If the 


first quantity is not greater than the second one, i.e., we have the inequality 


[rol m)aw <(B+1), (4.39) 
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if is nol necessary to carry out the first testing (in accordance with a criterion of total 
losses) and the estimate F* should be chosen as a priori information about the distribution 
function Fo. 

In the general case for decision making after conducting n tests, one has to use another 


similar inequality 
Fe (1—Fr) dW <c(B+n+}). 


This method is called the one-step procedure. Ferguson [82] has generalized this method 
for the case of multi-step procedures. 

Several authors have taken a different approach than Ferguson in using the Dirichlet distri- 
bution. As an example, we touch upon the works by Lochner and Basu (153-!55]. These 
works have practical usefulness, connected with a test of the hypothesis about a cumulative 
distribution function F (x) belonging to the class Sp including failure rate distributions. 
With a given sample of a device T = (T1,...,T,) = (t".t), where t" = (f,,...,75) is the 
vector of failure times, t = (f),...,f,) is a vector of times of nonrandom censoring. For 
some value ft, coinciding with one of the censoring times, we construct the set of values 
O= xX <x <x) <--+ <x», =T so that each value x; coincides with one of the moments 
of censoring The test statistic is of the form z = (5),...,5m,11,---.fm), where s; is the 


number of devices failed during the time (xj—1,x;], / = 1,2,....m,rj is the number of 


devices which tested successfully by the time x, (j= 1.....27 = 1), and r,, is the number of 
devices failed by the time x,,or having availurevatierw,,. Wer pam py... Py bSawector 
consisting of increments of the distribution function, p,  F(N,} - Fix, 1). As is proved 


in [153], z is a sufficient statistic for p. 


Further, we assume that p has a prior Dirichlet distribution with a density 


i=l aE Te 
h(P) ~ p}' vee pin =p) mit—l (4.40) 
on the set 
my 
P= \ po 0 < pee) — 1, y2< l 
j=) 
The numbers vy). 19..... Yin Vin | Are parameters of a prior distribution. Consider a vector 
u = (U),...,Um) such that wu) = (1 — p;) and 
Lp) = 
y= = f= 2, ae 
1p Ma 
The quantities #, are linked with a failure rate function of the device in the interval (f,1 =A): 
Fir A) Fir 
jee (t+ A) — F(t) 


Al — F()] 
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by the relation 


It follows from (4.41) that w;, u2,...., Um are a priori independent and subject to the beta- 


distribution with the probability density 
| Je 
hj(uj |v) ~ uw,’ (1—w,)* 3 V=(Vigeannel), 


where wj = vj4} +-+::+Vms1. Moreover, it follows from the property of conjugacy of a 
Dirichlet distribution that the distribution for which 


hj(uj | z,v)us? (1 —uy)P-! (4.41) 


where aj = Yi" j41(si+ ri + vi) +rj+Vm+1, Bj = 5; +; appears to be also posterior for 
u;. Since F is a random probability measure, the event F(t) € So is random. The following 


upper estimate is found in [154] for the probability P{F(r) € So | z, v}: 
P{F(t) € So | z,v} < P{uy <u <-++ < um | z,v}. 


With the help of (4.42) we can obtain 


1 puy um—I ope (1- u;)Pi-} 
Pity <2 hob < jin || & v} =[ ‘ of ee (4.42) 
; Apts 


I 
in addition, the finite analytical expression for integer B; is obtained in [155]. For large m 
the probability (4.43) is almost near to P{F(t) € So | z, v}. The procedure of estimating 
the fact that F(t) belongs to the class of failure rate distributions So is easily constructed 
starting from (4.43). 
In addition to the mentioned procedure, we can estimate, with the help of a prior density, 
the probabilities of future events. Let € be a failure time for the future testing or for the 


operation time. Then 
Eas avy =n pn yal —%), (4.43) 


where y; = a;/(a@; + B;), and hence 
P{E<xlzav}=L nn %i10-1) =1-[]y (4.44) 
j=l j=l 


Relations (4.44) and (4.45) allow us to find the estimate of any reliability indices. 

In the work [45] you can find a comparatively easy way of using the Ferguson scheme. The 
authors use as a priori information the empirical distribution function, constructed on some 
hypothetical sample t;, = (th, sthyren Lig) of the failure times. As a measure of significance 


of the prior information, B = @(R') is chosen the number m+ 1. If t* = (t],...,17) isa 
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sample of failure times, then the nonparametric Bayes estimate F*(r) of the distribution 


function F(t) in accordance with (4.6) has the form 


0 rie if eC). 
k 
F*(t) = ei if 1 <t< te; (K=0, 1,.-.,5), (4.45) 


1 if ts41 St, 


where {f),...,ts} is the sample in ascending order {t;.t}. The generalization of this result 


is given in [45] for the case of censored samples. 


4.3 Nonparametric Bayes estimates in which Dirichlet processes are not used 


4.3.1 Neutral to the right processes 


One of the general representations of stochastic processes which cannot be reduced to 
Dirichlet processes are the so-called neutral to the right processes initiated by Doksum 
[67]. A neutral to the right process, or NR-process, is introduced by Doksum in the form of 
a random probability measure F(t) on R! such that. for any t) and fs (rt; < f>) the relation 
(1 — F(t2)]/[1 — F(t1)] is independent of F for any t <1;. A NR-process can be expressed 
with the help of a process called a process with independent increments. 

The mentioned processes are introduced and investigated by Levy [138]. In accordance 
with his definition, Y is called a stochastic function with independent increments. it its 
increments Y,, = Y, — Y, on intersected segments [s.r) are independent. A process with 
independent increments is called a family of such stochastic functions, determined on some 
sample space with the same increments ({138]. p. 561). By means of }; a NR-process is 


determined in the following way [67]. 


Definition 4.3 (NR-process). A stochastic distribution function is said to be NR-process. 


if it can be represented in the form 
F(t)=1-e™, (4.46) 


where ¥, is a process with independent increments, besides. Y, is nondecreasing and con- 


tinuous to the right and 


tin Seo AS, Whit i == 0) aus. 


{[—+00 [——00 


In accordance with the theory of Lent, the stochastic process Y, has no more than a count- 


able number of discontinuity points f),f2..... The random variables S$). So..... determine 
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the jumps at the points f), f2,..., respectively. The process Z,, defined as the difference and 


sum of the jumps 
Z=% — LES iM, 00) (t); 
J 


where /g is set indicator function, is also a nondecreasing a.s. process with independent 
increments. Moreover, Z, does not contain the points of discontinuity and, therefore, has 


infinitely dividable distribution, satisfying the expression 
In E [e-| = 062) + [ (e-® -1)dmi(0), 
0 


where b(t) is a nondecreasing continuous function which tends to zero as f + —o, N, is a 
continuous Levy’s metric [138]. 

The main result of [67] is that, if x),...,x, is a sample of censored values of a random 
variable of the distribution F(t) which, in essence, is an NR-process, then the posterior 
distribution F(t) is also neutral to the right. Suppose that X is a univariate sample from 
F(t). Then the posterior distribution F(t) for X = x is neutral to the right. The posterior 
increment of the process Y(t) for tf > x coincides with a prior one, and a prior distribution 
of increments of the process Y, to the left of x can be obtained by multiplying the prior 
distribution by e >. Thus, if A(y) is a prior distribution density of the increment Y = Y, — ¥Y, 


for s <1 <x, then the posterior distribution density A(y) for X =x has the form 
h(y |x) ~e ~h(y). 


To find the posterior distribution of the process increment at the point x, Doksum [67] 
introduces the process Y, = lim, . 0 ¥,, which is continuous to the left a.s. and also has 
independent increments. With the help of this process, the jump at the point may be written 
as S = Y, — Y,. In spite of the simplicity of the representation of S, we cannot write the 
posterior distribution of the jump at the point x for each case. Its density we denote by 
hy (s |x). If x is a point of discontinuity fixed a priori with a p.d.f. of a jump hy(s), then 
hx(s |x) ~ (1 -e*)hx(s). 

The work by Ferguson and Phadia [83] is devoted to the generalization of the work by 
Doksum for the case of censored samples and touches upon question of construction of 
the general theory of NR-processes. The censoring, considered in [83], has the following 
difficulties: 1) the times of censoring are not random; 2) the authors distinguish two types 
of nonrandom censoring: including the censoring, satisfying the condition that X > x, and 
excluding censoring for which X > x. The posterior distribution F (7) for the given types of 


censoring is determined from the following theorem [83]. 
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Theorem 4.2. Let F(t) be a NR-random distribution function, x be a random sample of 


volume 1, x is a real number. Then 


a) the posterior distribution F under the condition X > x is neutral to the right, the poste- 
rior distribution of increments of the process Y, to the right of x coincides with a prior 
one, and Y = Y, —Y, fors <t <x satisfies the relation h(y | x) ~ e-*h(y); 

b) the posterior distribution F under the condition X 2 x is neutral to the right, the pos- 
terior distribution of the process Y, to the right of x or at the point x coincides with a 


prior one, and Y = Y, —Y, fors <t <x satisfies the relation hy |x) ~e ~h(y). 


The case of a censored sample will be simpler in view of Theorem 4.2.1. since it doesn’t 
require individual consideration of a prior distribution of the jump. 
The Bayes estimate of F(t) is sought for the quadratic loss function andappears to be a 


mean value of F(t). In accordance with definition (4.47), 


F*(t) = E[F(t)] =1-E [e"] =1-M,(1), (4.47) 
where M,(1) is the value of a moment-generating function M,(0) = E [e we] at the point 
6 = |. Now, suppose that x;,....x, is a sample and i)..... Wu, iS a sequence of elements 


of a sample distinct from one another, ordered so that uj) < wo <--> < mj. Denote by 


6;,..., 0, the numbers of noncensored observations, by v,..... ¥, Which are the numbers 
of exceptionally censored values, and [)..... My are the numbers of inclusively censored 
values of asample. The family of vectors u = (1)... KOO x. 2 SMa)... 2 VE) 


and = ([j,..., le) generate a testing statistic denoted by k. The quantity 
k 
ore} eameam 
i=j+l 
denotes the number of elements of the initial sample, exceeding u,. and j(t) 1s the number 
of elements u; of the ordered sample which are less than or equal to 7. We will also use the 


following notations: M, (@) ~ lim, .,,M@.(@) moment-generating function Y, . /,,(s) and 


i 
hu(s | w), respectively, the prior and the posterior p.d.f. of the jump S = Y, — Y,” at the point 
w under the condition X = 4. The main result of the work [83] is the expression for the 


posterior moment-generating function of the process Y;: 


M, (0+ @,; HO TM, (0 + @- inners: 
M,(0 | K) = M84 Oi) ees M,,(@i) 


M, (j1)) I My; (@;--1) Cy, (@; + vi, 6) ae 
(4.48) 


The function C,,(@, B) in (4.49) is detined as 
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(i) if wis a priori fixed point of discontinuity of the process Y,, then 


C, (ot, B) = few(1 —e)P u(s)ds: 


(ii) if wis not a priori fixed point of discontinuity, then 


Cie. B) =| Eee d ee h(s | u)ds 
for B > 1 andC = 0 for B = 0. 


The expression (4.49) enables us to find the Bayes estimate of F(r) and the estimate of any 
of its linear transformations. Let us write, in addition, the expression for the Bayes TTF 
estimate R(t) = 1 — F(r), assuming that t € R*‘. To simplify the expression of M,(1), we 


introduce (see [83]) the functions 
_M(o@+1) 


Cu(a+ 1, B) 
m,(@) = Re) ——— 


and 74(0,8)= C,(a,B) 


i) = 
R*(1) = E[R(t) | K] = M,(1| K) =m,(@,(t)) T] lO (a —v;,6;). (4.49) 
i=] Uji 


Obtaining a prior density of the jump h,,(s) at the point wv for a single observation h,(s) 
represents a significant difficulty for evaluation of the estimate (4.50). There is a subclass 
of NR-processes for which the problem solution is simplified. As an example we consider 
the so-called uniform processes, having the property that the increment of the process Y,; = 
—In(1 — F(t)) has the Levy’s function, which is independent of t. This means that moment 


generating function of the process Y(t) has the form 
Migi=ean Ln) : : (e® -1) an(s) (4.50) 
where N(-) is the Levy’s metric on (0,°), for which 
[a + 2) !dN(z) < ~, 


and y(t) is a nondecreasing function, where lim, . . Y(t) = 0, lim; .. Y(t) = ©. 
For the uniform NR-process, a prior p.d.f. of the jump of the process Y(r) at the point x, 
under the condition that one observation X = x appears, is independent of the value x and 


can be represented in the form 
h(s | x)ds ~ (—e*) dN(s). (4.51) 
We can easily write with the help of (4.52) under the given Levy’s metric the Bayes TTF 


estimate of R*(r). If one introduces the function 
/ e%(1—e-*)P dN(z), B21, 
0 
ip B=0, 


6(a,B.N) = (4.52) 
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then the functions C,(@. 8). m(Q), ry (@. 8). appearing in (4.50), may be rewritten in the 


form: 
$(0.B.N) ga, 
Chau) — (0, 1,N) 
i Bib. 
m,(Q) = exp[—7(r)@ (@,1,N)], (4.53) 
and 
_ o(a+1, B,N) 
ry(@, B) = are a (4.54) 


We give below some examples of nonparametric Bayes estimates for two special types of 


NR-processes. 


Example 4.5 (Gamma-process). If independent increments of the process Y; are- 
distributed, the process Y, is called a gamma process. A moment-generating function of 


a gamma-process can be written in one of the following three ways: 


qr!) 0 Be °. 
———— SCN) PA apd be 
M08) = Toa Ce 
t+0 0 


A gamma process has a parameter of a y(t) and a parameter of the inverse seale (or inten- 


sity) T independent of ¢. Using (4.51) and (4.56) for the Levy's metric, we can write 
dN(z) =e "27! dz. 

Thus, for the gamma-process the function (4.53) takes the form 

iis oT eS ede. maa 

| Ie Pmt. 


Since B is integer, (a. B) can be written in its final form using the binomial formula, and 


after integration becomes 


mapa (P5) nin (=). (4.57) 


=) asi 


o(a,B.n) ~ O(a. B) (4.56) 


With the help of (4.50) we can obtain the Bayes estimate of TTF for a prior uniform gamma- 


process: 
Yh) 5 (u,) 
ae a I lees O1(@, + Vi + T+ 1.5) 
@ i | (@;-1+7+1)(@47) or (@; + v; + T, 6;) 
(4.58) 
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It is interesting that the Dirichlet processes, considered above, a(R!) has a simple form, 
and a metric &(-) is represented with the help of the a prioti representation of the cumulative 
distribution function. In [83] Ferguson and Phadia investigate an analogous question for the 
gamma-processes. Suppose Ro(f) is the a priori information about TTF R(r). In accordance 
with (4.56), the parameters t and y(r) must satisfy the condition t/(t + 1)” = Ro(t). 
Hence it follows, that for any r, lying in the domain of definition of the function y(r), with 
a fixed T, is 
InRo(t 
ie eee 


The parameter t may be interpreted as a measure of certainty of a priori information. To 


(4.59) 


understand this interpretation it suffices to consider R*(t) for a single censored observation. 


For n = | and using (4.49) we obtain 


i Ro(t), feo 
R*(t) = E(R(t) |X =x] = | eau. ks (4.60) 
where 
— An{(t+2)/(t+ 0) 
a In{(t+1)/7] 


The function (tT) is monotonic, where, as T— © we have £(t) — 0, and as T > ~, 
¢(t) — 1. As seen from (4.60), for large t, £(t) is near to 1, and the estimate R*(t) is 
near to Ro(r). For small t, a prior form of TTF Ro(t) is changed substantially. To this 
end, it is interesting to consider the behavior of the estimate as t — 0, i.e., when we have 
no a priori information. Recall that a Bayes estimate based on Dirichlet processes under 
similar conditions tends to the estimate of maximum likelihood. In [83] this question is 
investigated in conformity with a noncensored sample for v; = 0, 6; = 1, and @ =n—-i 
for all i = 1,2,...,n. The parameter y(t) is chosen in accordance with (4.60). From the 
expression (4.61) putting tT — 0 one has 
In[(n+ 1)n| 

In{(n ~ f(t) +1)/(a—F())] 


This limit coincides with the maximum likelihood estimate. 


E|R(t) | K] > (4.61) 


Example 4.6 (A simple uniform process). This process was artificially chosen by Fergu- 
son to avoid the shortage of a gamma-process. A moment-generating function for the 


considered process has the form 


M,(@) = exp ) [ (eo % — te" (1 —e*) "dz ; (4.62) 
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The Levy’s metric is written as 


dN(z) =e""(1—e7*) dz. (4.63) 
A priori information for TTF Ro(t) allows us to write 
y(t) = —tInRo(t), (4.64) 


where the parameter T as before, can be interpreted as the degree of certainty in the prior 
information as given above, has a sense of certainty in a prior information. Using (4.65). 


we obtain the final expression of TTF given by 


t A(t) ae 7(a;_ 1 —@}) @O4yv4T 
R*(t) = E[R(t) | K] = [Ro(t)] @j(,) FT il [Ro(ui)| (@;_ 1 +) (co; +t) f Vit 


i=} 


O,-V,-0,-7 


(4.65) 
Ast—0 
S(t) ee 
oe if < uK, 
Rg) = ¢ LOTT (4.66) 
Rolt) gui iP e uK. 


Ro(ux) jap OE Vi + 6; 
coinciding with the maximum likelihood estimate. In particular. if the including censoring 


is absent; the estimate (4.67) is a Kaplan—Meier estimate. 


The work by Kalbfleisch [118], touching upon the Bayes analysis of the Koks reliability 
model, contains important results devoted to the practical use of NR-processes. The model 


is represented by the relation 
R(t) = P{E >1 | z} =exp|[—A(r) exp(zB)], (4.67) 


where z = (z1,Z2,.--,2n) is a vector of parameters of the system, B = (B;.fp..... Bp)’ 
is a vector of regression coefficients, and A(t) is a resource function as defined earlier. 
The problem is to estimate TTF of the form (4.68), starting from some a priori infor- 
mation about the distribution of the random variable € and results of the experiment. 
(el) oy... (trc!)), where <” isa realization of the vector z in the j-th test. 


The problem is solved in the following manner: 


(i) Starting with the a priori information, one chooses a prior estimate of the resource 
function Ao(r); 
(ii) For the chosen estimate of Ao(r). one finds the estimates of the regression coefficients 


of the model (4.68); 


(iii) Given vector B the posterior estimate of the resource function A*(t) is found. 
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The final expression for the TTF estimate is found by substitution of A(r) and the estimates 
of the regression coefficients into (4.68). 

To obtain the Bayes estimate of the resource function, we assume that A(r) is a stochastic 
process which we can study with the help of the following model. The positive semi-axis 
is divided into k nonintersecting segments [Q%, @), [Q,Q2),.-- ,[Qy—1,Q), where Q& = 0, 


Ot, =e, For each segment one introduces a conditional probability 
G@=P{6 € la, 0) 6 > GA}, (4.68) 


if P{§ > aj; | A} > 0, and otherwise g; = 1. It follows from (4.69) that A(a) = 0 and 


U 


I 
A(Qj) = oy —In(1 —g;) = Nery. =e 
j=l 


j=l 

It is assumed further that A(t) is a nondecreasing process with independent increments. 
Under this assumption we conclude that random variables q ,...,q, have independent prior 
distributions, and the stochastic process generated by q1,...,g4 is NR-process. In order to 
describe the stochastic process A(r), it is necessary to determine the distribution for the 
increments t = —In(1 —q;), i= 1,2,...,k. In the work [118] it is assumed that 7,..., %; 


have independent gamma-distributions 
GS T'(Q; — G-1, c) ’ (4.69) 


where c is some constant, and parameters ; are determined with the help of a resource 
function chosen in a specific way. The parameters c and Ag(t)have the following simple 
interpretation. If one considers a partition (0,1), [t,0o), then from (4.70) it follows that 
A(t) ~ P(cAo(t), c) and E{A(r)] = Ao(0), D[A(t)] = Ao(t)/c. Thus, Ag(t) has, in essence, 
a priori information about the resource function and c is a quantity characterizing the degree 
of significance of this a priori information. 

The estimates of the regression coefficients are found with the help of the maximum likeli- 
hood method using the following scheme. For the sample (r geal) ar ne) the distri- 


bution is written as 
n e 
Pein), eh Big Sep {- Y A(ti) exp (zB) (4.70) 
i=] 


which is conditional with respect to the stochastic process A(t). We denote by Zz a p x n- 
dimensional matrix with the outcomes of n tests. Clearly, for obtaining an estimate on B 
we require that the distribution (4.71) be independent of A(t). This is achieved with the 


assumption that 


Ti = A(t;) — A(tj-1) ~T(cAg(t;) —cAg(ti-1),c), hee etl 
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where, without loss of generality, 1) << +++ 7 t, and tg = 0. t)-) += ©. Here we use 1, 
instead of a; and apply the above reasoning. Since A(t;) = Li, , 7, the distribution (4.71) 


is rewritten in the following form: 


n 
at = a > te Bgris-ateer} == @Xp (-Zai) (4.71) 


where 


Integration of (4.71) over multivariate gamma-distribution (4.72) yields 


n 
Pye = ieee, Ba Tic | p.2} = exp (- iy <a,Aot)) A (4.72) 
j=1 
where 
B;=—In i —exp (cB) /(c+A))| é 
The expression (4.73) is valid for any Ag(r), discrete or continuous. If we assume that Aqir) 
is continuous and there are no samples of coinciding elements, then. by differentiation of 
(4.73), we may obtain a p.d.f., interpreted as a likelihood function /(B). In the final form 
the function £(B) is represented by the expression [118] 


[ [A0(2)B; (4.73) 


i=] 


e(B) = c" exp - y cB ;Ao(t;) 
j= 


where Ag(t) = A’ (rt). 

Further, the maximum likelihood estimate B., obtained by minimization of the function 
(4.74), is used for obtaining a prior Bayes estimate A*(r). This estimate is detined in [118] 
with the help of the property of conjugacy of a gamma-distribution, according to which the 
quantities r),r2,...,r, have as independent prior the gamma-distributions. We consider 
first the case of the univariate sample; thereafter, we shall give the generalization for the 


case of arbitrary n. The final result of {118] is contained in the following theorem. 


Theorem 4.3. [fa sample t = (ti .to...., ty) does not contain the same values and ty <tr < 


“++ < ty, then fort © |ty 1.t;) the posterior distribution A(t) coincides with the distribution 
of the sum of the random variables 
Xy +U, +++: +X;_-1 +U;_-1 + §, 
where 
Xj~T [cAo(t;-1) —cAo(t;), c+Aj| : 
6; ~T [cAo(tj-1) —cAo(t;-1), c+Aij], 
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and 
Uj~ U(c+Aj,c+Aj+1). 


The last distribution U (a,b) has the following density function: 


__ exp(—bu) — exp(—au) 
as uln(a/b) 


If one uses a quadratic loss function for obtaining a prior estimate of the resource function, 


f(u) 


the resulting expression will be 


=) 
A) =E|A0)| 23,6.) EEC) +20) +6), 
j=l 
where E(X;) and E(A;) are the expected values of the random variables having, respec- 
tively, gamma-distributions, and for E(U;) the following relation holds: 
eeD (2) B) c+A jit 
|S) = 
(C+A;)(C+Aj+1) +A; 
For small c that corresponds to the case of absence of a priori information, the values E(X ;) 


and E(A;) are near zero, and A*(t) is almost like a maximum likelihood estimate. 


Generalized gamma-processes 


Dykstra and Loud [70] solve a problem of estimating TTF by an alternative construction 
of gamma-processes which are not neutral to the right. A prior distribution, proposed in 
[70], is absolutely-continuous and cannot, therefore, be reduced to prior distributions by 
Ferguson and Doksum, as mentioned above. 

The method of construction of nonparametric Bayes estimate of TTF they have proposed 
is based on the so-called generalized gamma-processes (GG-processes), defined in the fol- 


lowing manner. Suppose the parameters of the gamma-distribution (a, B) with density 


_ al t\ Mo) (1) 

dep) =e) rape 
are functions of ¢. In addition, a(t) > 0 (t > 0) is a nondecreasing left continuous real- 
valued function, having a left-hand limit at the point 0. By Z(t) we denote a gamma-process 
having independent increments with respect to a(t). For any two points the increment 
Z(t) — Z(s) is independent of the process increment on the other interval, nonintersecting 
with [s,f], and obeys a gamma-distribution (a(t) — @(s), 1). In addition to this, Z(0) = 0. 


Ferguson [80] proves the existence of such a process. 
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Definition 4.4 (Definition of GG-process). Let a process Z(r) have nondecreasing contin- 


uous left-continuous sample trajectories. Then a stochastic process 
t 
a(t) = | B()dz(x), (4.74) 
Jo 


where B(x) is a positive right-continuous real-valued function, having a right-hand limit at 
the point x = 0 and integration carried out over the sample trajectories. 1s called a general- 


ized gamma-process I'(a(-), B(-)). 


The stochastic process (4.75) may be used to describe a random failure rate function. With 


the help of (4.75) one can write a random cumulative distribution function in the form 


Firy=1—exp - [ Asda (4.75) 


We compare this construction with the theory of NR-processes by Ferguson and Doksum. 
In accordance with the c.d.f., F(t) is neutral to the right if A(r) has independent increments. 
It is easy to see that the intensity function (4.75) is a process with independent increments. 
consequently A(t) doesn’ thave independent increments, and F(t) is not NR-process. 

It is proved in [70] that the characteristic function for A(r) in some neighborhood of the 


origin has the form 


f 
Wa1)(O) = exp{ - [ In[1 — iB(s)6] as) . 
hence the following formulas are valid for a mean value and variance: 


EA) = [ B(s)da(s), Dia())= [ B2(s)aa(s). (4.76) 
0 J0 


Using the representation of a failure rate with the help of GG-process. one can write the 


conditional distribution of a sample of size n in the form 


PAGES tie: Sr eee A = [lee - [xoar ; (4.77) 


tet 

We can obtain, using (4.78). a prior distribution of a random intensity A (1) fora given sam- 
ple. Note that since the process Z(1) has nondecreasing realizations, A (1), due to (4.75), is 
nondecreasing almost surely. Therefore. a priori information about the cumulative distri- 
bution function F(r) should be sought in the class of non-failure rate distributions So. 

A prior distribution for A(r) can be identified if the functions a@(r) and B(r) are given. 
These functions are determined by the expression (4.77) under the condition that both have 
a nondecreasing expected value u(r) and a variance o7(r) are given. The function p(r), in 


essence. has a priori information about A (rf), and the variance o(f) characterizes a measure 
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of uncertainty with respect to the value of a failure rate at each point t. Let us rewrite the 


relations (4.77) in the form 


u(t) = [ Bls)a'(s)ds, 0°) = [B()a(s)as, 


and hence, 
_ do*(t) sdu(r) 
Bi) = [= (4.78) 
and 
da(t) [du(t)]* ;do?(t) 
dt -| dt | dt ~ Gr) 


The expressions (4.79) and (4.80) let us write a prior distribution (a(t), B(t)). 


The following statements are proved in [70] for a prior distribution of a stochastic process 


A(t): 


(i) If tT = (t),t2,...,t,) is a completely censored sample, then '(a(-), B(-)) appears to be 


a prior distribution A(t) under the given sample t. where 
F B(t) 
Bn) = 


rae (4.80) 
1+ BO) ¥ —)x(-0) 


(ii) If t = (t].15,....1)) is a noncensored sample, the a posteriori distribution A(t) under 


the given sample T is a mix of generalized gamma-processes: 


PiA@e B|t)} = 


aor d : d d 

[oo [fyBear (ar (a+ ¥ 6B) Tha [es ft C 
{= i= — j=i 

0 0 


where F(B;Q) denotes the probability of the event B for the stochastic process, dis- 


tributed by the law Q, and integration is carried out from z; to z2. 


If one uses a quadratic loss function, then the posterior estimate of the failure rate A(r) is 
defined in the form of the posterior mean value. For the case when we deal with a com- 


pletely censored sample, We (t) appears to be a mean value corresponding to the distribution 
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ra(t) (t)), where B(t) ) is computed with the help of (4.81). For a noncensored sample. 


coe is a mean value of the variable distributed by the law (4.82) and can be written as 


ty ti pt d d : 
i of [Malet ¥ by=| (@) 
0 i=0 j=i=i 


a ft adalat £ bole (4.82) 
1 Pe d 
f°. fe IP zi) Each C-- iE I, (z;) 
= j=it+l © 
The censored data may be added if one computes A*(t) with the help of (4.83) and the 


estimate B calculated by the formula (4.81) both for censored and noncensored data. 


Other approaches 


We shall consider an interesting approach for the construction of a nonparametric Bayes 
TTF estimate proposed by Padgett and Wei [183] and not connected with the Ferguson ap- 
proach. A prior distribution is defined with the help of a step stochastic process for a failure 
rate A(r): the function A(t) represents, by itself, a step process with constant jumps. equal 
toe, atsthespomnts) 77, foe... which are the moments of the events of a Poisson process 
with intensity v. Such a representation of A(r) is connected with real physical interpreta- 
tion: at random moments 7), 7>,.... a technical device 1s subjected to a negative effect. 
which increases the failure rate by a positive quantity €. and jumps occur in accordance 
with a Poisson process. By virtue of our assumptions, one can write the expressions for the 


intensity function A(t) and resource function A(r) in the following form 


A(t) = eN(t) (4.83) 
and 
Nig) 
A(t) =e) (t-T), (4.84) 
| 


where N(1) is the number of Poisson events that have appeared by the moment 7. Thus. a 
prior distribution is defined with the help of the stochastic process A (1) on the parametric 
space @ determined by the set of all nondecreasing intensity functions. There are no addi- 
tional assumptions about F(t), except F(t) € Sy. The process R(r) is written with the help 
of A(t) as 


N(t) 


R(t) =1-—F(t) =exp | ‘A Asay =exp|—€ Y (t—T7;)| . (4.85) 


i 
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Note that the relation (4.86), under the chosen specification of A(t), gives the continuous 
representation for F(t) consequently, the considered approach cannot be reduced to Fergu- 
son and Doksum methods. In addition to this, we observe that the representation of a priori 
information has a simple, handy form: to find a prior process we need to know only two 
numbers: the height of a jump € and the parameter of the intensity of a Poisson process v. 

The posterior probability measure P,(B) for B € 6 is defined by the Bayes theorem, written 
in the following form 

Jp l(E,v, T)dPo 

fog l(E,¥,7)d Py’ 


where ¢(€,v,T) is a likelihood function, generated by a sample t. If t is a noncensored 


P,(B) = (4.86) 


sample, t = (t/,.... 17.t,....t), then for the likelihood function the following expression 
holds: 


N(7;) 
£(eyv5T) Fewer )[Jex -e Nex dL (i 1). (4.87) 


If one uses a quadratic loss function, then the posterior mean value R*(t), corresponding to 
the distribution (4.87), is the Bayes estimate and 


in which R(t) is defined by the expression (4.86), and @(€,v; T) is defined by the expression 


(4.88) 


(4.88). The integrals appearing in (4.89) express, in essence, a fact of averaging of corre- 


sponding integrands over all possible values N(t),...,N(T), T1,.--, Tiz,). For example, 


d n N(t%) 
[elewinar = [,lenilexp -ef dL e(T 7) 


i= Nye 


x dPIN(%),.-.:N (Tn), Tis--- Tira) - (4.89) 


To solve integrals of the type (4.90) requires special numerical algorithms. In [183] the 
authors represent one such algorithm. The problem may be solved only with computer 
tools. The numerical example demonstrates the possibility of practical use of the estimate 
(4.89) and its satisfactory quality. 

An interesting nonparametric solution is given by Proschan and Singpurwalla [198-199]. 
They considered the problem of estimating the failure rate of a technical device using the 
results of forced tests and a priori information of a special form. It is assumed that a device 
is tested in k regimes, and each regime is associated with its own failure rate function A(t), 


where 


Ai(t) > Ag(t) > > A(t) > A(e) (4.90) 
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and A(t) is a failure rate corresponding to the device functioning in a normal regime. For 
obtaining Bayes estimates, the authors use the following stochastic process. 
Let Nj(t) be the number of devices being tested in j-regime at the moment 1. The interval 
(0, L] of possible testing periods is divided by the points 51. 82..... into equal subintervals of 
length A so that the number of all intervals m = L/A. Also, let n,, be the number of devices 
tested in a j-regime during the i-period; dj; is the corresponding number of failures: p, , is 
the probability of observing a failure for the device tested in j-regime during the (-penod. 
The stochastic process we will use later is determined by the mean intensity in the interval 
[si,5;+ A]: 

yy = ——, i= 1,2,....m J 1)2,.. of, (4.91) 

1— ¥ pam 
e=1 
which is a conditional probability of a failure by the time s, ~ A under the condition that by 
the time s; the device is functioning. It is assumed that each , ; satisfies a beta-distribution 
Be(a, B;) with a density given by 
Hyi(P) = hyi(p; a, Bj) ~ p®' (1 — p)P; 

moreover, the random variables f;; are mutually independent. The set of all W,, gener- 
ates a Poisson process, defined on the parametric space, satisfying condition (4.91). The 
parameters a, B;, Bo,...,B, contain a priori information. To satisfy (4.91) it is necessary 
that Uj—1,; > Hi; almost surely for all j = 2,3,...,k. This has been proven in [199] under 
the condition that B) < ++: < By. This inequality symbolizes the difference in severity of 
testing. 
The procedure for obtaining posterior distributions of conditional probabilities U,, is based 
on the property of conjugacy of a beta-distribution in conformity to a specific sample plan 
which assumes that censoring is absent. It is proved in [198] that the posterior distribution 


of [1;,; is a beta distribution for a given Nj; and dj; 


V(a?,+Bii) os . 
fg UN. 0) i eee PO (La, (4.92) 
nes) POG) 
where Qj i = a+d;j, Bj = B; oat ja = djji- 


Now, if one uses a quadratic loss function to obtain the Bayes estimate Hj,. this estimate 
takes on the form of the posterior mean value, corresponding to the distribution (4.93): 
Os dj 
a+ By+ Nya 
The proposed approach characterizes, as a whole, the clearness of a logical construction 


Hi (4.93) 


and simplicity of the numerical algorithm. At the same time, we don’t know. unfortunately, 


in what way the parameters @ and f; (i = 1,...,m) should be chosen. 
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4.4 The nonparametric Bayes approach of quantile estimation for increasing 
failure rate 


Obtaining statistical conclusions about the value of a quantile x of the level p for failure 
rate distributions 1s a matter of great interest in reliability theory: 
Xp =inf{x: F(x) > p} (4.94) 


In this section we’ll consider a problem of obtaining the Bayes estimate for x, assuming 
that F(x) belongs to the class of failure rate distributions Sg. It is shown in [14] that for 
the approximation of failure rate c.d.f., it is customary to use a two-parametric family Eo 


of exponential cumulative distribution functions of the following form: 


F(t;0) =x(t—p) [ _exp (-—*}] . (4.95) 


where pf is absolutely guaranteed time to-failure, (+ m9), a mean TTF, 8 = (u +0). 


For this family, a p-level quantile has the form 


I 
Xp=H+moAp, with Ap =In- (4.96) 


In the present case Belyaev [14], uses a Bayes estimate of the quantile x,, obtained for 
the nonparametric family Eo, for the construction of the estimate of a similar quantile for 
F(t) € So. It is carried out by the specification of a transformation u, : F — Fo (F € So, 
Fo € Eo) and by the foundation of a lower bound of a prior probability of the statement 
{x, > x} over all possible transformations u,. The Bayes estimate x, is constructed with 
the help of a sample t = (r},...,13.%,--.,t,), obtained after the realization of the NC-plan. 
For the likelihood function £(@ | tT) = /(u,mo | T) we use the expression (3.22), and in 


accordance with it, 
finale) Scene =n) aes | [-voa| 
ym = ¢ {. — _ oe ; 
H,mo ae ij ~u mi P mo J 


where N(r) is the number of devices tested at the time f, c(T) is independent of UW, 179. This 


expression may be simplified if one takes into account the relations 
d 
* * 
[[vc —p)= x(t) —p), 
i=l 
where t/}) = min(t;,tj,..-,f3), and 


co ro) t 
i N(t)dt= | N(t)dt+ [nat =s(hiy) +s(uth), 
mn 1) ee 


where, the statistics s(ti)) and s(H.t)) have the total operating times during the testing 


period which lasts after the first failure 1) has occurred during the interval ae Al . If there 
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are no failures, one should put 1’; equal to the period of testing 7. The resulting expression 


for the likelihood function is 


; l (7, meer) 
€( | t) =c(t)x (tt, — Hu) — exp [ee] (4.97) 
mM) my 
A prior p.d.f. of the vector of parameters 6 = (ff .»9) is represented in the form 
A({t,mo) = h(mo (ut | mo), (4.98) 


where /(mg) is a prior p.d.f. of the parameter nig. A( {| mig) is a priori conditional p.d.f. of 
the parameter tt under the condition the parameter mo. If one uses a prior p.d.f. Al p.m). 


conjugated with a likelihood kernel, then an expression for Alm) and h(t.) takes on 


the form 
[ exp ( ]so°7exp =~ 
h(mo) = [ren ig) en) (4.99) 
(do — 3)! [ = (=z) | a 
and 


cate | 


1 —exp (-c2) mo 


A prior density, defined by the expressions (4.99)-(4.101), depends on four parameters: 


h(t | mo) = (4.100) 


c. to, do. So. Applying the Bayes theorem and relations (4.98)-(4.101), we can obtain the 


multipliers of the posterior distribution density corresponding to A(mp) and h(t my): 


{1 exp [202] } so(r)tott 2 exp [-24| 


-_ mM 
h(mo,t) = ae (4.101) 
(do+4—3) 41 [2 3) \ 
and 
; $1 (Wr) 
c+N(p) X(r—H)exp [- auest 
h(t | mo, t) = eae) et le (4.102) 
ag I — €xp [- 202) 
where 


r = min {15,10 Si (hor) | [c+ N(r\ldr. 
u 


s2(r) =so+s)(r), Si(r)  =c(t—r)+s(r). 


with help of (4.102) and (4.103) the posterior density of the vector of parameters @ = 


({1,mo) is found analogously to a prior one (see (4.99)): 


h({,mo | T) = h(mo | t)A(w | mo, r). 
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If F(r) is represented by the expression (4.96), then while the data is accumulated, the pos- 
terior distribution is concentrated in the neighborhood of the true values of the parameters 
if, mo. Accumulation of data corresponds to the union of testing outcomes over the set of 
tests, containing k NC-plans, as k increases infinitely. 

With the help of a prior p.d.f. (4.100) and (4.101), a prior density of the quantile Xp = 


[i +moA, is expressed in the following form: 


hp (Xp) fe h(mp | mo)h(mo)dmo 


II 


c(1 = p)sq""? (do — 2) 


53 S53 
x canta fa. (2) -etp-etena( etc) 
[ =i( ® | oo { do ee P 0 P xp —to 


where mp = Xp ~ moAp. $3 = 50 +.c(to — Xp), the integration interval G = ((xp —x9)/Ap)". 
Xai A,wand a” denotesattiat a= a, if the synibol a > 0, a* = 0, if a < 0, Lg(x) = 
Wagar ye! 

For the posterior p.d.f. h,(xp | 7) of the quantile values with the help of (4.102) and (4.103) 


one obtains analogously 


c+N(mp) so +s) (mp) 
=k/{| —_—— —————+|d 4.103 
Prlan| = K [SE ePenp [AAT | dm, 4.108) 
where 
0 (2 fa 


59(r) dy+d—2 : 
{1 [248] (dy +d —3)! 


and the interval over which we integrate is 


G = | ((xp ma r)/Mp) i xp/A)| ‘ 


For practical convenience, we use the posterior p.d.f. (4.104) to represent the integral 
(4.104) in the finite form. To this end we present the following scheme: consider a vari- 
ational raw t/)),..., t(;), consisting of the values of censoring times which precede r. The 
time ;) is associated with the finite increment of the integrand in (4.104). The set G' is 


divided into a sequence of intervals 
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with 
Ao = Gan) ee? 
Ap Ap 
In the intervals A; (¢ = 0. 1..... f), the function N(m,,) is constant. Suppose that at the 
censoring time f(;). N devices are taken out. Then N, = N ony — 0) is the number of 


devices which are still being tested after f,,. The constant values of the function Nim), i in 


the intervals A; are written in the following form: 


hae N if vapeae 
ie) = 
Hi N, if m € Aj, 


whence it easily follows 


(c+N)(t1)— mp) +s1(t1)), 0 € Ao, 
51 (mp) = ¢ (C+Ni) (tint) — mp) +51 (ti41)), moe A, i=1,...,€-1, 
(c+Me)(r—mp) +51(r), mo & Ay. 


The last expression lets us write 


N ) 
(ai) = f c+N(mp) = [ee im 
mo EA; 


noe mo 
so(e+Ni)(ti+1) —Xp) +51 (ti41)) 
ek {XC = ti) )Lidy-+d—2 (4,2 eal een 
— f41) 
Te eee — oe (4.104) 


where 
ve (dp +d —2)'(c +Ni)(1 — p)' a = (4.105) 
[so + (C+) (41) —Xp) +51 (taa1y) | 
The integrals J(Ag) and J(A;) are computed by the same formulas (4.105) and (4.106) in 
which one should put Nj = N.f,) - 0 for the first integral, and. V, =N,.t,.,  - r tor the 
second one. The resulting expression for the posterior quantile fia, | T) takes on the form 


of a sum 


ea) = KJ(A;). (4.106) 


The number of terms in (4.107) may be less than ( + 1, since some of the intervals A, 
degenerate into a point. 
The case corresponding to the situation when censoring is not carried out until the moment 


r (t(;) 2 r) is the most simple for calculations. In this case the sum (4.107) consists of only 
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one term, corresponding to i = 0. The posterior density of the quantile values has the form 


hp(xp | t) =W {Lansa-2 (a, SoH (CNC) $5109) 
P 


ae sate 


=; (4.107) 


Bo? Asn tg) Freer (a, 
where 


see! *(c tN) (1— p)"* (dod —2)! 


W = 
dy+d—2 : 
1 = anal er are 


52(0 


Za 


Fig.4.1 Approximation of the resource function 


The formula (4.108) may be used in tests which are conducted by the plans [N, U, R], 
[N, U, T], when N articles are being tested during the given time t, where the censoring is 
not carried out until the time f. 
Consider now an approach which enables us to use the above cited results for the condition 
when F(t) belongs to the class of failure rate distributions Sp. The problem is to make a 
statistical conclusion about the value of the quantile x, with the help of a sample Tt obtained 
while one is conductinga test by the NC-plan. To use the Bayes approach, we have to detine 
a prior distribution on the class So of all failure rate distribution functions. The method 
described below lets us, in some sense, bypass the difficulties of representation of a prior 
distribution. 
Any c.d.f., F(t) € Ep isa failure rate, since Ep € So. Let us define the map uw, : F(t) > Fo(r), 
where F(t) € So, Fo(t) € Eo. To do this, we put Fo(r) = F(t), if F(t) € Eo. Provided that 
F(t) ¢ Eo we assign to it c.d.f., Fo(t) € Eo, with 

Fo(t) = 1—exp(—Apo(t)), Ao(t) = max{0,A,+A,(t —xp)}- (4.108) 
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Here A, = tan@ the minimal possible value of the slope of the tangent of the slope @ . to 
the graph of the resource function A(t) = —In{1 F(r)}at the point (x,.A,). The graph of 
the resource function Ao(t) is a polygon line, containing the segment |. | and the ray of 
the straight line outgoing from the point (4.0) at the angle @ (Fig. 4.1). We can associate 
the map u, : F — Fo with the function up(r), such that 


F(t) = Fo(up(t)). 


As follows from (4.109) the function u,,(7) possesses the following properties: 


(i) up(t) is nondecreasing with respect to f; 
(ii) up(t) >t, Vt > 0; 


(iii) xp = Up(xp). 


If the function 1’ = u(t) were known, then realization of the Bayes approach to the problem 
of estimating of the quantile x, would be done without any difficulties. To do this one 


should use, instead of the data t, the transformed data 
Tn 4 ign ly 2yeee et 2, eae (4.109) 


where vj = up(t;), Oj = Up(t;). This data would correspond to c.d.f. Fo(t) < En. 
Any prior distribution on So being mapped by u, : F — Fo turns into the corresponding 
prior distribution on Eo. To simplify calculations. this distribution can be approximated 
by the distributions with p.d.f., represented by (4.100) and (4.101). Furthermore. we may 
use the calculations performed for the posterior p.d.f. fip(vp) T(up)). since the values of 
the quantile x, are the same for F(t) and F (19). We may find, using the posterior p.d.f. 
hy (Xp | T(ttp)), the posterior probability of the event x, > xv. This probability equals 

P{xy >x| t(up)} = [rol p(%p | t(tp))dxp. (4.110) 
We cannot solve the problem defined above using only (4.111) because we don’t know the 
mapping uw, : F — Fy which transforms the data T into the form (4.110). It is possible, 
however, to find the lower bound 

Po{xp 2x | t} =inf P{x, >x| t(up)}, (4.111) 

where inf is taken over the possible functions 1,(f) possessing the properties (i)-(ili). It 


can be achieved by scarching through all possible data T(u) Whose components v; and @; 


satisfy the inequalities 
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Table 4.3. The lower estimate of the ST probability of the statement {xp.9) > x} [14]. 


150 


The finding of inf in the problem (4.111) can be simplified substantially if censoring is 
not carried out until the first failure, ? = 0. In this case, we compute fip(x, | T(up)) using 
formula (4.108), and then inf in (4.111) is obtained by substituting s;(r) in (4.108) by 
Se Stir). 

The method of reducing a nonparametric problem to a parametric one, as described above, 
is called a method of concentration, since it is based on the idea of concentration of the 
prior distribution in the set Eo C So. 

We give a numerical example corresponding to the case 4 = 0 [14]. During the test a sample 


is obtained, containing 20 failure times, represented by the following ranked data set: 


{ 108.4, 120.8, 161.3, 172.4, 176.3, 177.3, 190.8, 267.8, 320.0, 331.5, 


334.6, 337.1, 352.4, 371.1, 440.8, 467.9, 480.8, 508.9, 567.4, 569.9} hours. 


In Table 4.3 we present the results of the calculations performed in accordance with the 
method of concentrations: the first row consists of the values of the posterior probability of 
the statement {x, > x}, corresponding to the given set of parameters fo, so, do and c under 
the assumption F(r) € Eo; the last row contains the values Po{x, > x | T} corresponding 
to (4.111). Decreasing of values Po{x, > x | tT} in comparison with P{x, > x | tT} will be 
significant for large values of x. It can be caused by the replacement of the family Eo by 
the broader class of failure rate c.d.f., So. 

The methods we’ve described above admit different generalizations. In particular, instead 


of the parametric family Ep, one can use E; € So, defined by the relations 
F(t) =1—-e M4), 


where 


Ap 
Ait —(Ay —Ao)xp, t>Xp, Xo a = 


which define a two-parametric family of c.d.f. The mapping u, : F — Fy € E; may be 
associated with the function u,(t), having the properties up)(t) <f and x») = up(xp). All 


further arguments will be the same. 


Chapter 5 


Quasi-Parametric Bayes Estimates of the TTF 
Probability 


5.1 Parametric approximations for a class of distributions with increasing 
failure rate 


A quasiparametric Bayes estimate plays the intermediate role between the parametric and 
nonparametric estimates in the following sense. Let {Q,.2,F} be a sample space, char- 
acterizing a Statistical model, generated by some plan P; a probability measure F (distri- 
bution) which belongs to some class S. A quasiparametric estimate of a time to failure 
probability r, connected functionally with F, is constructed in the following manner. Start- 
ing with given a priori information, the probability measure is approximated with the help 
of F € Sg, where Sg is a parametric family chosen in accordance with the form of repre- 
sentation of a priori information, where Sg € S. The parameter g is random and the space 
{@,&,H} where H € H is a prior probability measure of the parameter @ on (©, 2). The 
estimate of the probability of a TTF is sought in the form of the Bayes estimate of the cor- 
responding function R = R(@), measurable on @. A specific Bayes procedure is determined 
by the form of a priori information and by the chosen approximation of c.d.f., F, on the 
class S. These estimates are proposed and investigated in the works {218, 219]. Consider 
some important aspects from a practical point-of-view, cases dealing with a construction of 
the approximation of the unknown c.d.f., F(t), on the classes of failure rate Sg or failure 
rate in mean S$, distributions [9, 10]. Throughout what follows we will use a representation 


of the approximation distribution function with the help of the resource function: 
F(t) = F(t;@) = 1—exp |-A(1;6)| (HD 


assuming that A(t) is an approximation of the genuine resource function A(t) guaranteeing 


that the c.d.f. F(t, @) is in the class Sg (or S)). 
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5.1.1. The case of a univariate prior distribution 


This case characterizes the situation when an engineer possesses some information about 
the device reliability at the fixed moment fo, i-c.. if a prior p.d.f.. Afr). is given for TTF 
R,, = P{& > to} on the interval R,, R,. In this particular case h(r) can be uniform. and then 
it suffices to find the values R,, R,, to represent all a priori information. 

Suppose, at first, that R,, is fixed, i-e., the interval R,, R,, degenerates into a point. Fin 
such an approximation A(t) such that: 1) the values of c.d.f., F(r) and Fr; coincide. 2) the 
approximate c.d.f., F(t), belongs to the class of increasing failure rate distributions. In 


accordance with the first condition 

A(to) = A(to). (5.2) 
A(to) = —In{1 — F(to)] = —InR,,, and the value R;,,. by the assumption. is fixed. Represent 
the function in the form of a two linked polygonal line, satisfying the condition (5,2) (Figure 


5.1) and write the equations for the links. Since the link /; (1) passes through the origin. its 


equation will be defined by a single parameter which we denote by An. The condition (5.2) 


implies 
€\(t) =Ao(t), t <to, (5.3) 
where 
A(tg) I 
Ao = =—InR,, (5.4) 
to to 


i.e., Ao is defined uniquely, if R,, is given. The equation for the link #>(7) depends on two 


parameters: the parameter Ap mentioned above and a new parameter A;. Then 
€9(t) =Ayt— (Ay —Ao)to, ~t >To (335) 


Taking into account (5.3) and (5.5) we can represent the approximation of the resource 


function in the form 


Re) =Rirdos)= | dot, OSS to, 
Ait —(Ay —Ao)to, 1 >to, 


or, if we use the sign function, 
A(t) = X(t —t)Agt + x(t —t0) [Art — (Ar — Ao)to] (5.6) 


Note that the parameter Ao (given R,,) is defined uniquely by the relation (5.4). Atthe same 
time, for A; we may find only the domain of admissible values. To this end we use the 


assumption about the approximation of the c.d-f. F(t), belongs to the class So : 


F(t) = F(t;4,41) = 1—exp |-A(tsao,A)] as, (5.7) 
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A(t) 


Ao 


0 t, t 
Fig. 5.1 Two-linked approximation of the resource function. 


The condition (5.7) is equivalent to the statement that the resource function A(t) is concave 
[14], ie., 


- LT a 
A ¢ <) < 5 [A(t1) + Aa(t)| Vti<h (5.8) 


For the cases ft} < to, tg < to and, 1 > fo, t2 > to the condition (5.8) is filled for any A;. Let 


now ft; < to, f2 > to. Fort} +t2 < 2to (for concave A(t)) we have 
Ao (ti + t2) < Aoty + Arte — (Ai — Ao)to, 


whence A; > Ap. For t) +12 > 2t9 we obtain a similar result. Thus, the interval [Ago) 
appears to be the domain of values of the parameter A; guaranteeing the fulfillment of’ the 
condition (5.7). 

The TTF value R,,, in general, is not fixed but appears to be random, in the Bayes sense, 
and lies in the interval [Re Ru] - Therefore, we will discuss not a usual approximation of 
a resource function, but a Bayes one in which the parameters Ap and A; are random. The 
point is that the genuine resource function A(f) is random and may take on one realization 
in some space, determined by the given a priori information. In our case this space is 
bounded by the curves Aj(t) and A2(t) which also are random by themselves too. The 
fact that these curve pass respectively through the points (to, Ao) and (to, Aoi ve where 
Ag2 = —|nR;, Aoi = —In Ry, is nonrandom accordingly the segment of a prior uncertainty. 


In the class So the curves A;(t) and A(t) are approximated by the following polygonal 
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lines (see Fig 5.2): 


= 0, t<to, 
AG) = t 
( ) ——InR,, t>to, 
uit) 
and 
Tt 
eS ——InRy, t<fo. 
Ag(t)= 4 % 


ay i>, 


Thus, the resource function INGY defined by the expression (5.6), approximates an arbitrary 
random realization of the resource function A(t) € [Ai ae Ad(t )]. The parameters Ay and 
A; used in (5.6) are random variables. The range of the random variables A, and A, is 


defined by the inequalities 


MSA <A, AKA <%, (5.9) 
here Aj = —InR,/to, Ag = —InR_/to, and the first inequality has been obtained from the 


condition R,, € [R;,R,|, and the second one from the assumption F(t) = Sp. 

Define the domain D, having replaced in the above reasoning So by a more general class 
S; of failure rate distributions. The leading property of the class S; 1s the property of the 
nondecreasing of the function 7 (t) = A(t) /t. 


A(t) 


A,(t) 
K(t)=A(t;4,,4,) 


A (t)=-in[1-F(t)] 


Fig. 5.2 Bayes two-linked approximation of the resource function, 
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(see [14]). For the resource function A(t; Ao, A) of the form (5.6) with t > fo we have 
n(t) = Ay = (4 =o). 
From the condition 7’ (t) > there follows 
(a1 ~ Ao) "5 > 0, 


whence A; > Ao. Therefore, the assumption F(t) € So gives us the same domain for the 
random parameters Ag and A; of the form (5.9). 

It should be noted in conclusion that approximation of the resource function by the expres- 
sion (5.6) is equivalent to a rough replacement of the intensity function A (r) = A’(r) by the 


piecewise-constant function 


A(t) =A(t:A0,A1) = Aox (to —1) + X(t — 10). (5.10) 


5.1.2 Generalization of the case of a univariate prior distribution 


This can be carried out by increasing the number of links of the polygonal line used for 
the approximation of the resource function A(r). Let us choose some number f, so that the 
interval [0,7.] contains all empirical data. Next we divide the interval [0,7,] into N-+M 
intervals w; =[s;—1,5;), j= 1, 2,...,N+M of the same length, such that Sy =f, Svim = 
T,. It is easy to see that the interval [0,fo) contains N intervals My), U2,...,Hn, and fo, Te) 
is M intervals Uy .1,---,v--w. With the help of the obtained value lattice $2, 51,...,5v-+m 
we will approximate the intensity function A(t) inside the interval [0, 7.]. Suppose further 


that: 


1) The approximation of the intensity function at each point of the lattice gets on an incre- 
ment. The increment value is the same for all intervals u; € [0,fo) and equals 6; > 0. 
For the intervals Uj € (to, 7.) the value of a jump 6) differs, in general, from 6). The 
choice of different values for 6, and 6) is caused by the following circumstance: by the 
approach of the stated problem, 6; has a bounded variation induced by a segment of a 
prior uncertainty [Ry pale > is not subject to a similar restriction, hence, 6) € {0,0). 

2) The quantities 6; and 6) are taken as parameters of the approximation of the intensity 


function and play the role of the parameters Ag and A; from the previous case. 


We will distinguish between two approximations of the intensity function: an upper one 


A(t) and a lower one A(t). In Fig. 5.3, A(t) is shown by the solid line, and A(t) by the 


dotted line. Note that the approximations A (t) and A(t) are named as upper and lower ones 
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only conventionally, in view of the inequality A(t) 2 A(t). Actually it is not necessary that 
the double inequality A(t) < A(t) < A(t) be fulfilled. 
For the sake of simplicity we'll write 


a id w/e (Eile. isles, N 
i= | JO} Hj J 


(GiB) 
N&,+kb. VtE Unszy, &k=O0,1,..., M. 


In addition to this, it is clear that A(t) - A(t) - 6;. To find a more handy expression, we 
use the function 
1 if te py. 


X(t) = x(t 1-1) 4-9) = 0 if t¢ pj. 


A(t) 


Sow SH, 5, HS, HW, SL HS SS, Ue 5S, HS, f 


Fig. 5.3 Multiply-linked approximation of the intensity function. 


After simple transformations we obtain 


Nt mn mt 

= 6 Erinn nut + Sx) opal. (5.12) 
j=l =i k=I 

Formal integration of the ae function (5.12) lets us find an expression for the approx- 


imate resource function A(t = A(t: 6,.62). After some complicated transformations one 


can obtain 


n m 


A(t:8), 5 ape I p A+ jt, 1)| XC) + Dkr [1 (i= 181 +K)-142]A 


7 LS 


+ (N65; + ia) (t- svar) ansi(t}, (5.13) 
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where 
A=$ji1—Sj, Kn =0O+1+---+m (m=0, 1, 2,...). 


For further approximation of the resource function, we proceed analogously: 
n 
A(t; 61,62) = & Y [Kj-2A+ (j- 1)(t—j-1)] 41) 
ae =) 


+) {Ky-1AiA+ [(N—1)(7-1)6) + Kj-12] A 
j=l 


+ [(N — 1); + 55] (¢ —swaj-1) } x (0) (5.14) 
The expressions we have obtained represent, by themselves, the basis for solution of the 
problem of finding TTF estimates in the Bayes problem setting. 
The qualitative characteristic of the Bayes approximation of the resource function, given 
by (5.13), is represented by Fig. 5.4. Since we don’t change the form of representation 
of a priori information, i.e., R,, € [Ry,R,]| the function A(t; 51, 62) belongs to the domain 
bounded by the curves A; (rt) and A2 (t) introduced earlier. Define the domain ds formed by 
the possible values of the parameters 6, and 65. As before, we will start from the interval of 
a prior uncertainty [R,;,R,| and suppose that F(t) belongs to the failure rate class of mean 
distributions. 


Taking into account the chosen approximation of the resource function, we have 
Ry, =exp{—A (10; 51,82) } € [Re,Ri)- (5.15) 

At the same time, (5.13) yields 

A(to) = knAAt. (5.16) 
Using (5.15) and (5.16), we obtain 

Ry < exp(—K,,AA)) < R,, 

whence 

5} <A <j, 
where 

j= ~<InR,, A= —<InRr, and A; = K,A. 

Further, taking into account the condition 
a A ao] 


> 0, 
ot t 
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under which the c.d.f. F (t;5;,62) =! exp [-A(r)| belongs to the class of distributions 
with increasing failure rate on the average, we obtain 6) 2 0. Thus, the range dg of the 
random parameters 6, and 6) of the approximation of the resource functions D(t) and D*(t) 


has a structure 
6} <A; < Ai, 0<Ar<~ (5.17) 


This completes the construction of Bayes parametric approximation of the c.d.f. on the 


class S$; for a univariate prior probability distribution. 


A(t) 


Fig. 5.4 Bayes multiply-linked approximation of the resource function. 


5.1.3. The case of a multivariate prior distribution 


This case characterizes the situation when an engineer possesses a priori information about 
reliability for the given set of moments fyy.foo..... tao. In particular. it may occur that for 
each of the mentioned moments is given the interval of a prior indeterminacy [RoR jul. 
p= 1,2,....M. We will solve the problem of construction of the parametric approximation 
for c.d.f. F(t) in the following cases: 

(1) Uncertain intervals [R je Rea satisfy the condition of consistency. We will distinguish 


two conditions of consistency: strict and nonstrict. In accordance with the first condition, 
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the intervals of a prior uncertainty may be partially overlapping, but Rj, < Ri jyiye and 
R ju < Rij-1)y- For the condition of strict consistency such overlapping is inadmissible, i.e., 
Rj 2 R(j+1)u- The indicated forms of representation of prior information are depicted in 
Fig. 5.5. and Fig. 5.6. Note that in practice we may meet both forms, depending on the 
methods of obtaining and using a priori information. Evidently, if the condition of nonstrict 
consistency is fulfilled, we should include in the statistical model additional conditions, 
ensuring monotonicity of the reliability function. 

(2) An intensity function is approximated by a piecewise-constant function A(t), having 
finite increments t9,/20,...,two. In the capacity of model parameters one chooses con- 
stant values of the intensity function on the intervals [tj-1)0>t70); [ema IETS 
assumed also that t(441)9 = ©. 

In accordance with the second assumption, the approximate intensity function can be writ- 
ten in the form 


M+1 


A(th= ¥ Ajx;(t), (5.18) 
jel 


where A,, A2,...,mAy--; are parameters of the function (t). The approximate resource 


function A (t), in view of (5.18), can be written as 


M+1 


iS jl 
A(t) = Y° x,(t) @ Ai (tio —ti-1)0) +A, (t -‘y-19)) (5.19) 
j=l i=| 


Find the domain of admissible values of the random parameters A), A2,...,Aywi1. AS 
it follows from the problem setting, this domain must be completely determined by the 
intervals of a prior uncertainty [Rie Ries jJ = 1,2,...,M, and the approximate c.d.f. 
F(t) =1—exp |-awn)| belongs to the class of failure rate mean distributions. For t = tio, 


from (5.19) we obtain 
Rio = exp [A (n0)| = exp(—Ajt10). 
Thereafter, from the inequality R}g < Rio < Rj, there follows 


] 1 
——InR\, <A, < ——nRjp. (5.20) 
to No 
Let us now obtain an analogous inequality for any time fj. Having denoted A; = fo — 


t(j-1)0> with the help of (5.19) we can write 


Rjo = exp |-A (ti0)] = exp (x24) 


i=1 
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Fig. 5.5 Intervals of a prior uncertainty under the condition of fulfillment of nonstrict consistency 


Using the j-th interval of a prior uncertainty [Rye R jul inside of which lies the value R jo. 


we obtain 


whence follows the inequality for A; 


1 yet 1 eail 
—Z | Rint DU AiA: | < Ai < — InRjet+ Yo AA; |. (5.21) 
J i=) J i=1 


Fig. 5.6 Intervals of a prior uncertainty under the condition of fulfillment of strict consistency. 


Now, we apply the condition of F(t) belonging to the class $,. Introduce for A(t) the 
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function 7(t) = A(t)/t. For an arbitrary interval [t(;-1)0,t;] we obtain 


fai 
n(t) =+ » aril 1-90) : 


i=) 


The derivative of the function 7 (t) has the form 


1 it 
n’(t) = Pp tun 1s ; 
a 
and from the condition 7’(t) > 0 it follows that 
Ai Ay +AzA2 + +--+ Aj-1Aj-1 
Aieeigae =A; | 


Putting together the inequalities (5.21), (5.22) and (5.20), we obtain the following domain 


ay > (5.22) 


d, of values of the parameters A), A2,...,Agz41 under the fulfillment of the condition of 


nonstrict consistency for the intervals of a prior uncertainty: 


Wee! = 1,2). 


(O23) 
Au+i < Am+1 Keo, 
where 
He dais poke 
] A lus ] Ay 2e 
fai 
val X AiAj 
t i = 
A, = max a4 (i+ 5a), al Re oe ee 
ioe X Ai 
i=] 
and 


In the case when the indeterminacy interval satisfies the condition of strict consistency 


R j¢ > Ri j+1)w it is easy to show that 


I fell fis fail 
—— | inRwt Y adi) < Yai / DY Av 
Aj i=) i=l i=] 
Thus the common relation (5.23) for the domain d, has the same form, and the expression 
for Aj. j=2,3,...,M, changes into 
| et 
ae InRjy+ AA; |. 
i i=| 
Note that the model of approximation of a c.d.f., considered in 5.1.3 generalizes the case of 


a univariate prior distribution, i.e., having put M = 1, we obtain all relations given in 5.1.1. 
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5.2 Approximation of the posterior distribution of a time to failure probability 
for the simplest distribution function 


The solution of the problem of Bayes estimate of reliability indices under the given para- 
metric approximation of ac.d.f. F(t) follows the Bayes procedure described in Chapter 2. 
This procedure consists of determining the expression for the likelihood function, forming 
of prior distribution on the given parametric space. and obtaining the posterior distribution 
for the parameters of the approximate c.d.f. with the help of the Bayes theorem. In turn, 
the indicated posterior distribution lets us find arbitrary estimates of the required reliability 
index. 

As it was done earlier, we begin with censored data, obtained after realization of the NC- 
plan. We represent these data as a vector oaneent wihierest” a(t} it3 6... 1) is a vector 
of failure moments, t = (tr Nise aa is a vector of standstills (random and determinate). 
The ways of representing the posterior information depends substantially on the chosen 
approximation of the c.d.f. F(t). Therefore, we shall consider separately each of the cases. 


discussed in § 5.1. 


5.2.1 The case of a univariate prior distribution 


This case is parameterized with the help of the quantities Ap and A;. which represent the 
failure rate in the intervals [0,f9) and [fo.ce), respectively. To find a reliability function 
corresponding to this case, we will use the usual expression (3.21) for the NC-plan. Having 
substituted the expressions (5.6)and (5.10) into (3.21), we obtain 


d 


€(Ag, Ay | t) = c(t) [ [ [x (to 17) Ao + x(t? — t0)Au] 


i= 


d+k 
xexp4 — )° (to — ti) Aoti + x (4: —to) [Arty + (Ar — Ao)to] (5.24) 
i=} 
Denote by do and dj, respectively, the number of tailures observed before and after r by ko. 
and k; is the number of standstills before and after fp. Clearly dy +d; =dandka +k, =k. 
Thus, 
d 


[ [ [x (to — #7 ao + (07 — 10) Ar] = Ag? ay" 


taal 


d+k ae 
Sate-ave0, Taos, 


=| i=! 
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and 
d+k 


Yi x (ti — 7) t = (di +k )to. 
i-| 
The statistics Q& and a can be interpreted as the operating times before and after the time, 


fo, respectively. Substituting the obtained relations into (5.24), we can rewrite the likelihood 


function £(Ao, A; | T) in a shorter form, that is, 


&(Ao, Ar | tT) =(t)AMAM exp {— [A (a + mito) +A (a1 +n1to)]}, (5.25) 

where n, = d; +k. 
Now, we shall prove that the function (Ag, A; | T) has a bounded variation in the domain 
D defined by the relation (5.9). To this end, it suffices to prove that the expression in the 
square brackets is not less than zero. This follows easily from the inequality 

d+k 

a = ye (ti —to)t; > (di +h )to = mito. 

i=l 
As can be seen from the relation (5.25), the quantities dg, a), ko, kj, where kp = Q +nj!0, 
k; = Q + n)to, generate the minimal sufficient statistic. The resulting expression for the 


likelihood function is written in the form 


€(Ao, Ar | t) = c(t) AS? AM exp [—(Aoko + Arki)] (5.26) 
Let us now consider the problem of choosing the prior probability distribution. One of the 
most frequently applied methods is to choose a prior which is conjugate to the maximum- 
likelihood kernel. Appealing to (5.26), the prior density hp(Ao,A;) in this case can be 
written as 


hp(Ao,di) = BAgragie Hover he (5.27) 


where f is a normalizing factor. Now the kernel of the posterior p.d.f., in accordance with 
the Bayes theorem, takes the form 
hip(Ao, A | t1) ~ Ag? ALT exp {—[(ao + ko)Ao + (a1 +k1)Ai]}, (Ao, Ar) €D. 

Verification of the possible application of the conjugated prior distributions has been done 
in Chapter 2. The main difficulty in the practical use is that one cannot choose the prior 
p.d.f. parameters in a sufficiently justified way. Here, we deal with four such parameters: 
Co; C1, Go, O&, but one cannot givea method for assigning their values. 

There is an alternative method for the choice of a prior distribution, partially used in Chap- 
ter 3. In determining a prior p.d.f. h(Ag,A;), one uses only the segment of a prior uncer- 


tainty [Ry Rul and the assumption of uniformity of the TTF distribution R,, : 


hear = Ry; 
(Oa tn ve : (5.28) 
0, r< Re, r>Ry. 
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We seek a prior p.d.f. A(Ao, A; ) in the form 
h(Ao, Ar) = ho(Ao)hi (Ar | Ao). (5.29) 
At first we define a marginal p.d.f. ho(Ag). Taking into account the dependence R,,, = 
exp(—Apofo), we obtain 
ho(Ao) = h (Ri, (Ao)) [Ri (Ao)| 
= er ome reny (5.30) 


Since the parameters Ap and A; have the same meaning. we define the conditional p.d-f. 


R, —Rr ; 


hy (Ay, Ag) analogous to (5.30), i-e., we will assume that h; (A). Ag) belongs to the parametric 
family of truncated exponential distributions. Suppose. conditionally. that some value of 
A, is associated with a totally defined TTF value at the time fo; 
Ry = exp(—Ajto). (5.31) 

Since A, € [Ap,), we obtain R; € [Rz,R1y]; moreover, 

Rie= lime™™ 0 and Ry, =e 4, (5.32) 
Taking into account the relations (5.31) and (5.32), analogous to (5.30), one obtains 

hi(Ar | 20) = pee, Ap < Ay < om 

and finally 


hy (Ay | Ao) = toe 41-70, Ag Ay < om. (5.33) 
Next we substitute the expressions (5.30) and (5.33) into (5.29) and write the finite relation 


for a prior p.d.f. of the parameters Ap and A; : 


h(Ao, A) = 1 gate (Ao, A1) € D. (5.34) 
R,—R; 

There is no explicit dependence on the parameter Ap. However, the form p.d.f. appears to 
be a joint probability density function of the parameters Ay and A). since the dependence 
on Ao is expressed by the form of D. It should be noted that the obtained p.d.f. /1( Ap. Ay) 
is a partial case of theconjugated prior p.d.f. Ap)(Ao.A1). represented by the expression 
(5.27) with the parameters cy = cy ~ Q& = 0. Q fo: the above given arguments may 
be considered as a method to justify the choice of the parameters of the conjugated prior 
distribution. 
Using a prior density (5.34) and the likelihood function (5.26) and taking into account the 


Bayes theorem, we write the kernel of the desired posterior p.d_f. 


h(Ao, Ar | t) ~ AGO AM! exp {—[Aoko +A1 (ki +10)]} (5.35) 
which will be used as the basis for obtaining estimates of the probability in the following 


section. 
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5.2.2 The generalized case of a univariate a prior distribution 


This case is characterized by the posterior distribution which has a more complicated form 
(bearing in mind the numerical aspects). The upper approximations of the resource function 
A(t; 6;,62) and intensity function A(t; 5),62) are chosen as the basis for further research. 


The expression (3.21) for the likelihood function takes on the form 


CGR o> | tT) = c( op Tee 2.8)09| Late or, 5) (5.36) 


If one substitutes the relation (5.12) and (5.13) into (5.36), it yields 


€(6,6) | T) = c(t ol pac JENS gwen(tt ) +8 Y kava || 


1 k=1 


m 


ces) 8 | Kj-14+ j(t —s;-1)) x(t] - Ye {Rnd a + [N (j — 1); + Kj-2&)|A 


v1 j=) 


—(N6, + j52) (t — sv +j- anes} (37) 


It is impossible to use such an expression of the likelihood function, so we simplify it with 
the help of the following formulas valid for the functions A(t) and A(t) : 


N+M 


th= ) Ayxj(), (5.38) 
j=l 
N4+M{ j-l_ _ 
= ye AY Agt+Aj(t—sj-1) ie) (5.39) 
Be [be = 
Here we use the parameters in (j = 1,2,...,N+™M), the set of which ts redundant because 


all parameters are determined uniquely by 6; and 6. In view of the expressions (5.38) and 
(5.11), we may conclude that 7 depends on 6; and 6. With the help of (5.38) and (5.39), 


the likelihood function iswritten as 
d N+M_ 


eSmey (2) =e(t) [| Yo Ayal) 
fealh jj] 


n NiM j-\ 
ven | 5 aba va p= 5) 5 zie}. (5.40) 


met jel | eI 


Consider separately each of the multipliers in th expression (5.40), 


-T] eb Aiailt} 


i} 


(5.41) 
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Denote by d; > 0(j = 1,2,...,.N+M) the number of failures observed in the j-th partition 


interval. Represent the product (5.41) in the form 


N+M [ 4) N+M_ 
=T] Tl d Aexe(t} ) (5.42) 


j=! liia & 
Since for the expression in the square brackets of the formula (5.42) the index 7 takes on a 
completely defined value, one gets 
N+M [{ 4 _ N4M_ 
Aa [] ( i) = De (5.43) 


j=1 \ij=l 


Substituting the expressions (5.11) into (5.43) we obtain 
dy 
k=1 i,=0 i 


The last expression will be represented in the form of a polynomial by means of 6; and és. 


To this end, we unite the similar terms and introduce a new index J = 1) = I> — +--+: ~ Ty. 
Finally, 
n D) 
Ay = [] i775)" Yad} 5)?" (5.44) 
j=l I=0 
where 


dy;idy+2 dnim m d 
SNE Inlllse cal oe) 


ij=0i%2=0 = im=O0 k= Ik 


and 
Dj =d\+-++:+d,, Dz =dn4it-->+dnem. 


Define the second multiplier of the likelihood function as 


n N+M fel 
Apemexp ( — )° d +. cial a xara] (5.45) 


i 
Denote by /; the set of indices of the sample elements T = (t).T..... t,). belonging to the 
segment pj (see Figure 5.3). Thereafter, the expression (5.45) is rewritten in the following 
manner: 


—InA» = ¥ A(t; —50) + 3 [A+ Aa(zi—s1)| + 


ich, i€l; 


cs yy aa+ fae + Anim—1A+ Aye (7; —svem-1)| 


i€In\M 
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HGF asad 5 Bal = Hae, 


i€l; k=j+liek jr 


It is easy to see that the obtained statistic 


N+M 
k=)Vi(a-si)+ Y YA (5.46) 
i€l; k=j+lich, 


represents by itself a total operating time during the testing, observed in the j-th interval. 


With the help of (5.46) we represent A> in the form 


N+M _ 
Ar =exp|— ) i) ; (5.47) 
j=l 


The resulting expression for the likelihood multiplier Az will be obtained, if we substitute 
(5.40) into (5.47). 


A2 = exp [1 (aj A) +a7A,)| : (5.48) 
where 
N N+M N 
=e yy k;, a= Yo jin (5.49) 
j=l j=N+1 j=l 


We have found all components of the formula (5.41). Thus, 


N Dy 
COO clo iili'0, ) aieo,* 7122). (5.50) 
j=l 1=0 


The coefficient a in the function (5.50) depends only on the number of failures 
dy+i, dv+2,---,dnim, observed in the interval u; (j > N). Thus, in view of (5.50), the 
minimal sufficient statistic is generated by the quantities Dj, dy.1, dy+2,...,dnim, 41, a. 
The kernel of the likelihood function (5.50) allows us to write the conjugated prior p.d.f. of 


the form 
hy (61, 52) = BO, 5y2e7 91-22, (5, 5) € Dg (5.51) 


where U,, U2, , Q are the parameters of a prior distribution, B is the normalized factor, 
and Dg has the form (5.17). In view of the Bayes theorem for the posterior p.d.f. of the 


parameters 6, 62, we obtain 
Di+U; ga © ee 
h(d,62 | t) ~ 6;! 152 Y, 00) 0, 7 
720 


x exp (— [(a; + a )d; + (a2 + 2) 62]). (5.52) 


The main difficulties in using the expressions (5.51) and (5.52) in practical situations is the 


problem of defining the parameters of a prior law. 
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If one uses as given only the assumption about uniformity of the TTF distribution at the 
time fo in the interval [R;,R,,], a prior p.d.f. can be obtained in the following way. Suppose 


the parameters 6; and 6) are independent and a prior p.d.f. is sought in the form 


h(5,, 82) = hy (d2)h2(2), (6), 62) € Dg. (5.59) 


Using the expressions (5.15) and (5.16) and the property of monotonicity of the dependence 


R,, on 6), we get 
hy(5,) = teh, 8 <5, <8". (5.54) 


The expression for /2(5y) will be sought in the class of truncated exponential distributions. 
defined by the density (5.54). The given assumption is justified in view of the same meaning 


of the parameters 6; and 6). Since 6) € (0,00), for h2(d2) we obtain 


hy(5)) = KmAeW m2, 0 < & <&. 


Z 


Denote by A; = K,A, Az = K,,A. Then the resulting expression for a prior p.d.f. 1.6). 65) 
takes the form 

h(5,,8)) = tae _e-(A16i+82%) (8, 8) E Dg. (5.55) 

R, —R; 

The obtained p.d.f. appears to be a particular case of a conjugated prior p.d.f. (5.51) 
with U; = Ur -— 0, oy = A), G2 = Ar. The arguments used above may be interpreted as a 
Justification for the method of a choice of the parameters of the conjugate prior p.d.f. if we 
take into consideration onlythe interval of a prior uncertainty. 


With the help of the Bayes theorem we get 


D> 


(81, 8p | t) ~~ SP! 51 SP2-! x elles +6181 +(02+8)8]_ (8.5) EDs. (5.56) 
7 


The expression (5.56) has been obtained with the help of the upper approximation for the 
resource and intensity functions. Reasoning similarly we may obtain the posterior p.d.f. 


for the corresponding lower approximations. 


5.2.3. The case of an m-variate prior distribution 


This case was described in §5.1 with the help of approximating the functions of intensity 
(5.18) and resource (5.19). Each of them depends on M + 1 parameters A;.Ad..... Asis 


Am -1. the parameters being the constant values of the intensity in the intervals (0.t10). 
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[t0,t20).---, [t1—1)0> two). (ta0,0°). Substituting the expressions (5.18) and (5.19) into 
(3.21), we obtain 


on -F X(T) YP Ae (tho =e -1)0) +A; (=; vo) (57) 
k=l 


To simplify the last relation, we introduce statistics d), d2,...,dm,dy+1, being the number 
of failures observed in the indicated intervals, respectively. It is easy to verify the validity 


of the expression 
d 
IT & aszslit) = bay’. (5.58) 


If one denotes by /; the set of indices of the sample clements belonging to the interval 
[t, rer tio). then the second multiplier of the likelihood function can also be simplified: 


amas 


ar pit =H 10) + Ay (ti — tj 9) 


=! j=1 


M+1 M+1 
= =a Ee Ti — tae) + ys ¥ (wun) O39) 


i€l; k=j+lich 


The obtained statistic 


M+1 
ky (a—ty-10)+ EY (to -te-190), (5.60) 
il; k=j+lich 


as already stated, can be interpreted as the total operating time, fixed during the testing 
in the interval [tj 1)0-7;0). Substituting the expressions (5.58)--(5.60) into the expression 


(5.57) we obtain the expression for the likelihood function 


M+1 M+1 
&(A | t) = c(t) i A‘! exp (- aE a) (5.61) 
j=l 


With the help of this expression, we can represent the kernel of the conjugate prior p.d.f. in 


the form of 
MH M+) 
hy (Ai, --»,Am41) ~ I] Aj’ exp = ‘e GA; A (5.62) 
jel j=) 


where cj; and a; (j = 1, 2,...,M + 1) are the parameters of a prion p.d.f., and the kernel of 


the posterior p.d.f. in the form 


M+\ on 
hold Aa 0) ~ EL ae | YE (aj+4) vi] (5.63) 
j=l jl 
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Here, we restrict ourselves only to obtaining an expression for the posterior probability 
densities. As is seen from the above arguments, the approach is independent of the method 
of constructing the parametric approximation. The differences among the approximating 
functions require us to use various methods of simplification, assigned to determine the 


sufficient one and write the simplest expression for the likelihood function. 


5.3 Bayes estimates of a time to failure probability for the restricted increasing 
failure rate distributions 


In this section we describe the method of obtaining Bayes TTF estimates using a two-linked 
piecewise-linear approximation of the resource function of the form (5.6). This form is 
chosen because of its simplicity. The knowledge of the posterior distribution lets us find. in 
principle, any numerical estimateof the TTF. There are, nevertheless, such cases that make 
us either apply complicated analytic constructions or use numerical methods. The goal of 


this section is to obtain finite analytic relations for TTF estimates. 


5.3.1 Bayes TTF estimates for the case t < to 


The value of a TTF in the interval [0.9]. in accordance with the chosen approximation of 


the resource function (5.6), has the form 
R(t) =e) =e! t <I. (5.64) 


Since the R(t) is defined by only one parameter Ap, to define the estimates of r it is neces- 
sary to know a marginal posterior density fy (Ao | T). This density is obtained by integrating 


the joint posterior density h(Ao, A; | tT) over the parameter 1: 


ho(do 1) =f (Ao, An |e) da 


a Agie-tolo | Aille Alkittol gy. Ap < Ao < Ag (5.65) 
} 
We shall be using the known integral 
eo n yoy 
[ eM deerme) 7 “ate, (5.66) 
k 0 


where n‘*) — n!/(n —k)!. Having performed the integration of (5.65) we obtain 


d, : d\-i 
fi(Ag | £) ~ e~Aolbotkr +0) ado 5 g(_A 5.67 
‘0 » 1 (ky +t) Ca 
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For a quadratic loss function, the desired pointwise estimate R*(t) is written in the form of 


the posterior mean value 


Ag 
R(t) = | * e*t hg (Ag | t)dAo. (5.68) 
{) 
The posterior variance 02, W)? using the estimate R*(r), is written analogously: 
2 Ay —Agt me 2 
6h.) = ie et hg (Ap | 2) do — [R*(t)]°. (5.69) 
The expressions (5.68), (5.69) may be represented in shorter form 
Bx Ay (t) 2 H(t) 5 2 
R*(t) = aS — |R* : : 
(t) H(t) and O%..,) A(t) [R*(t)| (5.70) 


where 
ay ae die dy —i 
Hea) = —kAgt) |— ky +10)] x Aj’ )). ———_An! ‘dd. 
KC) = f° exe(—kAot) [alba + ka +00] 49" Ye 
Using the integral (5.66) we obtain the resulting expression of the function H;(r): 


H ‘ dj CC (d—i)\) praia} ! 
Ef) ae, A Ei. —Ag(ko + ki +to + kt 
KO = 2 erty De Tee phe ply F Ra (20) "exp [Aa (ho + hi +10 +40) 


— (Ag)? exp [—Ag (ko + ki +10 + kt)] \ (5.71) 


Taking into account the form of the expression H;(t), we introduce the following handy 


dimensionless statistics: 


Nios n 
ene We (5.72) 
10 Seo = 
ky Z Tj Ma 
o=—=)) | --1) x(4-%) = )(w—1)x(vi- 1), (5.73) 
1 ey 80 zi 


where V; = 7;/to. The use of the statistics @ and @ lets us represent the sample of testing 
results in the form of relative operating times v;. Due to this fact we will use as initial 
data the vector v = {v*,v’}, where v* = (v,,...,Va) is the vector of respective failure 
moments, and v’ = (Vj,...,V«) is the vector of relative standstills of the testing. 

Thereafter, the sufficient Statistic, corresponding to the source sample T, for the distribu- 
tion function F(t:Ao,A1) is written in the form of the set {@,@,,d,d,}. The statistic @ 
represents by itself the total relative operating times during the testing, @, is the total rela- 
tive operating time after thetime fo. It is not necessary to divide the vector Vv into v* and v’ 


in order to evaluate @, and @. Information about the partition of the sample into failures 
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and standstills is contained in the statistic d (the total number of failures out of ) and d 
(the number of failures after the time fg). 


Now the resulting expression for the estimates (5.70) can be written as 
a I y(@, Q ,d,d, ) 


R*(t)= ; (5.74) 
( ) Ip. y(@, @,d,d)) 
and 
Ih y(@, @ ,d,d)) 2 
oad he ak SEI ; 55 
0 py(o,0,,d,d) 2) 


The function i, ¥(@, @,,d,d) is identically equal to the function H;,(t) except. instead of r. 


one uses the dimensionless parameter v = t/fo. Thus, 
dj d? d-i (d—i)) 
I.v(@,1,d,d,) = )) ——+__ y° p=] 


SG (Or +1) (at kee 1) 


lepine?! ieee tiny ena (5.76) 
The value of the lower confidence estimate Ry(t) which characterizes the exactness of the 


obtained estimate R* (tf) may be analogously written: 


Poocc-tor ep, B0(40 | #)d20-7=0. (5.77) 
R3(1)<e40'<R, 


To find RAL). we introduce a new variable x such that Ry(1) = exp(—at). The equation 


(5.77) is written as 
J] tos | t)dag —y=0. 
Using the relation (5.66), after transformations similar to the procedure of obtaining the 
function (5.76), we get the resulting expression for Ri(0): 
d di? 


d-1 (d —i)') = oa 
Viale ss... I 
dL (@ F re y (@ ts hye Rs |InR,,| 


SR er 


#l/v,..|4-f 5 
InRy/” (1)! "| ~ ylo.v(,01,d,d;) = 0. (5.78) 


If we want to find the TTF estimates for the case t= fo, we should put v = | in the expres- 
sions (5.74), (5.75) and (5.78). 

Next we investigate the posterior distribution of the estimated TTF index. This investigation 
is of methodological interest. Consider the case f = fg (V = 1). Taking into account the 
monotonicity of the dependence R(fo) = exp(—Aofo), for the posterior density of the index 


R(to) we will have 


h(ro | T) = h(Ao (ro) | t) |g (r0)] - (5.79) 
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After substitution of (5.77) into (5.79) and some simplifications we obtain 


InRo|7! 
(ro | t) = re Sal Foeaiaa or (5.80) 


where B = Ip.) (@,@,d,d) +1). 

In Figure 5.7 (a, b), we represent examples of concrete realizations of a posterior density 
(5.80) with fixed @ and @; and different d and d,. It can be seen that for the fixed d and 
increasing d; (d; = 0,1, 2,...,d) the curve fig (ro | T) biases to the right, which corre- 
sponds to the posterior value of TTF which is larger. This is in full agreement with practice 
and the engineering interpretation of the considered scheme: while d) increases (the other 
parameters remain fixed), the number of tests, ended by failures, increases too, and the 
number of failures, occurring before the time fo, decreases.That is, the considered situation 


corresponds to the higher reliability level. 


h(r,\t) 


Fig. 5.7 The posterior density of the TTF distribution. 


Tables 5.1—5.3 give the calculation results touching upon the values of the estimates R’ (to). 
OR (1 > Ry ) carried out with the formulas (5.74)—(5.78) for the fixed sample consisting 
of 10 ie and different d and d,. Analyzing these tables we come to the following 
conclusion. While d; increases and d is fixed, R* (to) and Ry (1) increase, confirming the 
obtained earlier qualitative result. Diagonal elements possess the property of asymptoti- 


cal stability. Therefore, if the number of failures increases (in the case when all failures 
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Table 5.1 The Bayes point-wise TF estimate. 


7 9 
0.8755 0.8510 | 0.842% 0.8315 


0.8830 0.8547 ir 0.8330 
— FH 


0.9230 896: 0.8612 | 0.8511 


Q.841% | 0.8355 
if 


0.8720 | 0.8577 | 0.8472 | 0.8398 


0.8887 | 0.4699 0), 5456 


0.9166 | 0.8887 | 0.8689 0.8548 


0.9164 | 0.8884 


0.9829 9163, 0.8882 
al 


9.9162 


0.9839 


Reig) Rp = 08. Rowe: SOAP wr 1085 


occur after the time fg, i.e., d} = d), the Bayes estimates, starting from some value. don’t 
change, unless the values of the statistics @ and @, remain constant. This result may be 
interpreted in the following usual way. If the article has been tested during the time 1. 
then the TTF value at this moment must not have an effect on the failures that occur after 
to. The mentioned property emphasizes the flexibility of Bayes procedures. Calculations 
of TTF estimates detect the existence of the dead zone for a priori information, that is. such 
intervals of a prior uncertainty for which the deviation of their endpoints does not have an 
effect on the TTF values. The graphs in Fig. 5.8 illustrate this fact. As seen from Fig. 5.8, 


the less the value of d is (e., the greater the reliability is), the greater the dead zone. 


5.3.2 Bayes estimates of TTF for t > to 
In accordance with the approximation of (5.6), for t > fo, we have 
R(t) =R(t,Ao, Ar) = exp{—[Ayt — (Ay — Ao)to]} . (5.81) 


In the given case TTF depends on two parameters. Thus, in order to obtain the estimates 
of the index (5.81) it is necessary to use the posterior density fi(Ay.A, 7). Taking into 


account the expression (5.35), we denote the kernel of the posterior density by 


Co(Aodi) = Ag? AS exp { — [Aoko + Ai (ki +t0)]}. (5.82) 
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Table 5.2 The posterior mean squared value. 


3 
0.0383 0.0424 


d 


ps 


0.0291 


0.0409 
0.0410 
___| e110 | 0.0475 | 
|| 810 | 


Gp) Re=08, Ry=1.0; @=30.73; @ = 11.13 


and define the normalizing factor in the form of the following integral: 


d+2 dy (i) d=i _ AU) 
p= |fcolor)dios =(+) YA a 


10 fy Our 1) ly, (@+1)7*! 


x (ROM IR, — REM fine), (5.83) 
Let us find the estimate R* (t) for the quadratic loss function in the form of a prior mean 


value of the function (5.81): 
mk ] 
R*(t) = B exp { —[Aoko + A1 (ki +10)] } Co(Ao, Ai \dAodAy 
= ghbe Ay (koto) dA, ifs Ages! (ky Ho)d4,. 
Ay 
Having used the integral (5.66) twice and passed to the dimensionless parameters @, @), 


and V, one finally gets 
: 14 di? di (d—i)) 
R*(t) me. +l L }) +1 
6 (@ + Vv)! j= (@+V +1) 
, Coe In Ry [2-1-3 — RO+V+! \InR,|4 ie!) 


Deviation of the expression for the posterior variance ors is similar to that for R*(r). 


(t) 
Introduce the function " 
dg) deg) 
0, 0),d24) = ——— (d—i) 


£5 (@1 + Om)'t) = (@ + mv + 1st 
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Table 5.3 The Bayes lower confidence limit. 


ef fo. 


7 & y) 


0.8195 0.8089 | 9.8066 | 9 &0S2 


2 | 0.816% 


0.8126 


0.9137 | 0.8694 | 0.8409 
0.9036 | 0.8582 


0.8110 0 S060) 


0.8079 | 


0.8483 9.8258 | O.8IS% y O8102 | O8N73 


(1.8945 | 0.8468 | 0.8246 | 9.8146 | 0.8097 


0.8462 


M8241) 08143 


() S94} I $460 } 08240 


1) 894] 


O94] 


Ri o(to) Re=0.8, R,=1.0; @=30.73; o = 11.13 


where, 


2V= 1. Sieee. 
: . 3 . rer ? . 
Then the resulting expressions for the estimates R* (1) and Oj. , are written as 


Ji y(@, @),d,d)) > Jr y(@,@,d,d)) 


R(t) = ane rn and 0) Jov(@.@y,d-d,) — R(t). (5.85) 
We need to obtain the equation for Ry (t). Taking into account the relation (2.34) we can 
write 
{ A(AgeAulec ld asean oy = 0. (5.86) 
[RUA Ay) >Rv(1)] 
[aor D| 


To simplify the integration domain in (5.86), let R(t) — exp(—yto) and y be an unknown 


variable. The condition R(t) > RY) is rewritten in the form of the inequality 
Ait — (Ay — Ao)to < yto 
or, with the help of the dimensionless parameter v, 


Ai(v-1) +o <y. (5.87) 
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Fig. 5.8 The dependence of the Bayes confidence TTF limit on lower value of the interval of a prior uncertainty. 


Domains D and Dy, defined by (5.87), are shown in Fig. 5.9. The domain Dy, is bounded 
by the curve a, having the equation y = A;(v — 1) + Ao, and coordinate axes Ag, A,. The 
domain D = {Aj < Ap < Aq’, Ao < A; } is depicted by the vertical dash lines. The intersection 
DN Dy is written in the form of two inequalities: 


y—A 


vo 


Ag < 40 <9, AWKAK< 


The problem of obtaining y and Ri (7) = exp(—yfo) has the following geometrical inter- 
pretation: it is necessary to find a value of the variable y such that the integral from the 
posterior density h(Ap, A; | T) over the domain DM Dy is equal to the confidence probabil- 


ity y. The resulting equation takes on the form 
S; (R}(t)) — Sz (RY(t)) — Woy(@, o,d,d)) =0 (5.88) 


where 


ia d—i) - 
Si(x) = Loti 2 (a +1) jirl Ly ie eo x (REIKI — sO! lin 


t/y am: ‘) 
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ke 


é 


Fig. 5.9 Integration domain for obtaining the Bayes confidence limit of a TTF. 


and 
aaa bo \aridint rg; | 
— _ ick 
0)= 2 aye :) r( : ) jinxié i 
t— = 
44* (do +k)? [, eo, wee il 
a ger se [s alin, [Kd — x+y | | 
; a 
iS! 
where 


v(@— @) —(@— 1) pa ot! 
v—1 rn oo 


The equation (5.88) is transcendental and quite complicated. However. the numerical inte- 


_— 


a= , and do =d—d,. 

gration may be performed without any difficultics since this equation has only one root in 
the interval [Ry,R,,]. 

The calculation results, obtained with the help of expressions (5.85) and (5.87). are pre- 
sented in Tables 5.4-5.6. The table data emphasize the inconsistency of the chosen method. 
Actually, for a fixed d; the estimates R (t) and Ry(t) are decreasing while d is increasing. 
In contrast to Tables 5.1-5.3, Tables 5.4-5.6 don’t contain equal diagonal elements. It ap- 
pears to be natural, since for R(fo) the failures, occurred after fo, are insignificant. At the 
same time, this fact plays the leading role for R(t) when t > fo. 

The length of the interval [R;,R,,] effects the TTF estimates similarly to the one in the pre- 


vious case. It should be noted that decrease of the difference R,, — Ry induces the estimates 
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Table 5.4 The Bayes point-wise TTF estimate R*(1) as t > to. 


[aE sl 
o.sas2 | 08354 


hse 
0.8750 | 0.8553 

L 
| 0.800 
= pera aa 
a 
| |_| 0.7208 | 0.7057 | 

— a ee 


0.7680 0.7578 
|_| 0.6978 


Re Ode = 1) == 0 on tle) Ver 14 


R*(t) and R}{1) to approach each other while the parameter v increases. This property is 
illustrated in Figure 5.10. 
As can be seen from Fig. 5.10, the TTF estimates decrease while v increases. This empha- 


sizes the naturalness of the dependence of TTF estimates on the dimensionless parameter v. 


5.3.3 Investigation of the certainty of the derived estimates 


The exact error estimate of the proposed method in the class of failure rate distributions 
has not been found yet. Therefore, we have used a statistical model to justify the obtained 
results. We model successively samples of sizes 20, 40, 60, 80 of the random variable 


having the Weibull distribution with c.d_f. 


F(t) = F(t;0,a@)—1—exp (4) : 


belonging to the class of failure rate distributions. Censoring from the right is carried 
out for @& = 1, 2,3 and different intervals of a prior uncertainty [R;,R,|. In Table 5.7 we 
represent a fragment of the results of modeling, namely, the point-wise TTF estimates 
R* (to), obtained with the help of (4.38) for v = 1, ¢ =f = 100s, 0== 350s, k) = 0.75, 
ky = 2.0, and 6 = 0.8. Comparing these estimates with the exact value of TTF, we may 


draw the following conclusions: 
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Table 5.5 The posterior mean squared value Op. ;,) for! > &. 


fa 9 
a 
0.0388 | 0.0363 | 0.0343 | 0.0329 03 0.2 0.0288 
0.0455 04! 0.0412 0.059% | ‘Os 0.0375 | 0.0368 


0.0528 | 0.0506 " 0.0472 0462 | 0.0453 | 0.0448 


0.0555 | 0.0540 | 0.0529 | 0.0520 | OOSIS 
——— —— - 


4 


0.0613 | 0.0596 | 0.0583 = | 0.0567 


0.0659 | 0.0644 | 0.0628 | 0.0416 | 0.060% 
00669 0.0653 | 0.0642 


0.0704 | 0.0668 | 00673 


Q.0732 


R,=0.9; R,=1.0; @=30.73; @ =11.13; v=-=14 


1) With increase of a sample volume, the estimate R* (fo) tends to the exact value of Rito): 
2) Construction of the interval of a prior uncertainty [R,.R,,) induces a more precise (with 


respect to R(fo)) value of the estimate. 


For t 4 to (v # 1) the Bayes estimate R*(r) behaves in the following way: the approach 
of the pointwise estimate approximation to the exact value R(r) in the interval ‘0.979. 1.119. 
is analogous to the one represented in Table 5.7, that is, it is satisfactory: outside of this 
interval, it is not satisfactory. This fact is illustrated in Fig. 5.11. Consequently, we identify 
the following important practical recommendation: for a priori information for the TTF 


R(t) estimating the intervals of a prior uncertainty for the times near to should be chosen. 


5.4 Bayes estimates of a TTF probability for the restricted increasing failure 
rate distributions 


In this section, we shall discuss a method of approximation of the cumulative distribution 
function F(r), based on the expression (5.6), and apply it to the TTF probability estimation 
in the case of so called restricted failure rate distributions. defined by the limit value of the 
growth rate for the intensity function. The use of such a method enables us to estimate the 
limit error with the help of the chosen approximation. We will study the case of censored 


testing results and a prior information that reduces to a uniform prior distribution of the 
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Table 5.6 The Bayes lower confidence limit Rf 9(to) for t > fo. 


ae eae 
0.8446 | 0.8433 | 0.8424 | 0.8315 


0.8287 | 08243 | 08238 
0.8287 | 0.8243 | 0.8238 ! 
08289 | 08261 

8102 | 0.8094 
| 
0.7549 
pf || 7008 | 0.5998 | 0.5990 | 0.6987, 
2 2 aes 
ee 
La | il TY a | 


Reo: R= 1.0; we 30:73; w= 11.13; vaer=14 


0.8722 


ee 


required TTF in the interval [Ry,R,| < [0,1]. 


5.4.1. Parametric approximation on the class of restricted failure rate distribu- 
tions 


We will use a two parametric approximation of the resource function (5.6) in application to 
certain subclasses of increasing failure rate distributions. 

Definition of a class of restricted increasing failure rate distributions A class of probability 
distributions S9(6) C Sp is said to be a restricted failure rateclass or 6-failure rate class, if 


for any distributionfunction F (x) € So(6) the relation 
O<A'(x) <5 (5.89) 


holds, where A(x) = F’(x)/(1 — F(x)) is the failure rate function. 
It is clear that for 6 > 0 the class So(6) is nonempty and So(cc) = So. For 6 = 0, the class 
So(5) degenerates into a parametric family of exponential distributions. 


A probability distribution function 


Fys(x) = Frs (x; a,c) = 1—exp |- (ax+ 5) 


for c > 0 will be called, by analogy, the linear failure rate. The class of all linear failure 
rate distributions, determined by the condition c < A, will be denoted by S75(6). It is clear 


that S,s3(5) C So(S), where, 6 > 0 the class S,5(5) is nonempty. We will approximate 
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Fig. 5.10 Dependence of the Bayes TTF estimates on dimensionless parameter. 


an unknown time to failure distribution function F(x) < So(d) with the help of a function 
F(x) = F(x;a, 0) = 1—exp [A(x; 0, 8)]. Here 

A(x;a,0) = x(t —x)ax+x(x—-1)[@x— (6 —a)r], (5.90) 
tis the time for which the TTF ts defined, @. 0 are parameters. The following lemma 


clarifies the relationship between F(x) and a class of linear failure rate distributions. 


Lemma 5.1. Let parameters a and 8 belong to the set 


0(6) ={(a@,0): a0, a@=eaeeor. 


Then for the approximating function F (x) the following relation holds: 


Frs(x;02,0) < F(x:a,0) < Frs(x;a@,8). 


Proof. The failure rate function A (a) A(x: a. @) can be written with the help of (5.90) 
in the form A(x) = x(t —x)@ + x(x —1)0. Under the lemma conditions (@.@) € Q(d) the 


relation 


A < A(x; @,0) < Ao(x) 
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Fig. 5.11 Comparison of the Bayes TTF estimate with its exact values for the Weibull distribution. 


holds; moreover, A; = & and Aj(x) = a@ + 5(x) appear to be, respectively, the intensity 
functions of the distributions Fzs5(x;a@,0) and Fys(x;a,6). The proof of the lemma follows 
from the above double inequality after the transformation of the failure rate function into a 


distribution function. O 


5.4.2 Approximate estimates TTF of Bayes for the class So(5) 


To formulate the problem, let us assume the following: 


(1) F(x) € So(8), with the value 6 given; 

(2) The estimating TTF R(r) = 1 — F(t) during the given time interval has a uniform prior 
distribution in the segment [Ry,R,| C [0, 1]; 

(3) The testing results have the form of a censored sample t = {t*,t}, obtained after the 
NC-plan realization. The problem is to obtain the posterior density f,(r | Tt) of the 


required TTF and estimate R*(t) for a quadratic loss function. 
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Table 5.7 Comparison of the Bayes posterior pointwise estimate (to) with a real TTF value 
R(ty) for the Weibull distribution. 


Ol R(t) = 0.7515 | 
Ry Rr niewe2() rim) n 60 n &0 
0.80 0.7432 0.7420 0.7548 0.7449 al 
0.60 0.85 0.7074 | 0.7098 0.7618 0.7384 
—_—|-- 
0,50 0.90 0.7044 0.7654 0.7386 
0.6947 | 0.2085 | 0.7655 | 0.7387 
ine R(t) = 0.9216 
—— ae 
oe Oe | 0.9227 0.9237 0.9247 0.9223 
0.80 0.96 0.9280 ().9334 0.9219 
0.70 0.98 0.9429 0.9465 0.9264 
0.9526 | 0.9515 0.9512 0.9268 | 
R(t) = 0.9769 
092 | 099 | 09628 | 09697 | 09716 | o9nK 
—_ mT 
| o90 | 100 | 09636 | 09771 | 09838 | 09756 


We seek the approximate solution of the problem using the analytic substitution of the 
function F(x) € So(6), given by the expression (5.90), instead of the unknown distribution 
function F(x) € So(5). We additionally require that the relation F(t) = F(t) (Le.. the values 
of the true unknown distribution function and the values of its approximating function 
coincide at ime f for which the TTF R(t) is defined). In view of this assumption. the 


parameter a is uniquely determined by the unknown value of R(t): 
a= a(R(t)) = —InR(t)/r. (5.91) 


Thus, we will determine the posterior density of the TTF and the corresponding point- 
wise estimate for the parametric class of distribution functions F(x: a.@), where (@.0) € 
Q(;R) Ry) C Q(5), where Q(5;R7,R,) = {(@.0): a! <a <a", a < OK at Gr}. 
a’ = —InR,/t, o” = —1nR;/t. A prior density h(a, @) is sought in the form 


h(a, 0) =h,(@)h2(0 | a). (5.92) 


Taking into account the assumption (2) and the monotonic dependence (5.91). we obtain 


t 
h\(a@) =———e™, awe [a’,a”] € (0,0). (5.93) 
R, =I 
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Requiring additionally that the conditional density h7(@,a) belongs to the class of trun- 
cated exponential densities given by the relation (5.93), we find 
e (8-a)r 


t 
Fe 


37: 4G la,a+ di). (5.94) 
—e- ft 


h2(@ | a) degenerates into the delta-function when tf = 0. We write the joint prior density 
h(6@, a) having substituted (5.93) and (5.94) into (5.92): 


t? exp(—9r) 
(Ru — Re) (1 — exp(—6??))’ 


The likelihood function ¢(@,@ | t) for F(x; 0,0) can be found analogously to (5.26) and 


hie a) = (@, 0) € Q(5,Ry,R,). (6.95) 
has the following form: 
C(a,0 | t) = K(t)a% 0% exp[—(aKo + OK), (5.96) 
where 
Ko= Yan —T)+mt, Kj= Yate —t)—nit, 
and : : 


n n n 
m=) x(i-t), d=Pxt-), a=) x(i-2), 
tay i=l i=! 


where K(T) is a function which depends only on the data T. 
The posterior density f,(r| T) is uniquely determined by the prior density h(a, @) and the 
likelihood function £(@, @ | 7). 


Theorem 5.1. Suppose a prior density h(a,@) has the form (5.95). Then the following 
relation holds true for the posterior density h,(r | t) of the TTF probability R(t) = 1 —- 
F(t;0,0) € [Re, Ru]: 
d . ih d\—k 51?(@ +1) (842 d\—k 
a at ACNE) eee [(-Inr) 1 — @ OPNONEN (Ore — In) 
Py (@+1)ki! 
for 6 >Oand 
hy (r| 0) ~ r?(—Inr) Ot 

ford = 0, where @, = K\/t, O= (Ko + K})/t. 
Proof. Taking into account the expression (5.91), we obtain 


R(t) = exp(—arr). 


Therefore, in order to obtain h,(r | 7), we have to find hi; (a@ | 7). 


158 Bayesian Theory and Methods with Applications 


First, let 6 > 0. In accordance with the Bayes theorem f(a@.@ 7) ~ h(@.@)f(a.@ T). 


whence, using the expressions (5.95) and (5.96), we obtain 
h(a.0|t) ~ 00" exp{—|aKy + O(K, +1)|}.  (a@.0)2 Q(E:R,.Ry). (5.97) 


Integration of (5.97) with respect to g over the interval [@.@ + 61) yields 


d (k) 
h(a | t) ~ ae tog (Ki +) a ——_ ; acai +) (gpa pydr-K] 
Fr 6 (Ky + fryer : 
Cae’. (5.98) 
Since @ = a(r) = —Inr/r, for hr(r | T) we have 


f(r |) = |a'(r)| a (e(r) | 2) ~ opr (Inv) 


d (k) . 
x ys i ‘ ne [(- In rj -k e5!7 (ao +1!) (61? —In ry" ~*) ; (5.99) 
k=0 


which proves the first part of the theorem. 
For 6 = 0a prior density f2(@ | @) degenerates into a delta-function. and for h(@.@ 7) 


the expression 
h(a, 0 | t) ~ a4 6% exp {—[a(Ko +1) + @Ki]} Ao(@ — @) 


holds, where Ag (x) denotes the delta-function of the variable @. Using the filtering property 


of the delta-function, we obtain 
h(a|t) = | h(a, 0 | t)d@ ~ or2 +4 @—2(Ko+Ki +1), 
Now, by analogy with (5.99), we can write 
| 
h(n |t) ~ ay r?(=Inr)F4 
which proves the second part of the theorem. O 


Using Theorem 5.1, it is easy to find the posterior pointwise TTF estimate for 6 > 0 and 
the quadratic loss function: 
I (R, : R,,) 


Se 5.100 
Io(Rr. Ri) ( ) 


| 
RUDY = i phe |e aime 
J0 
where 


d (k) - é 
d; p : (d—k)© (Rein \d—k—I 


In(Rr Ry (@ Sree)! 
ty pte ETE gg Corrente) 


4 d\—k Ld] iia) 
— (Rem InRyl* k-1 Sere! (@,;+1) y Sr? ye (d k j) 


- d~h 
= fg Ose me 1)e 
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x cane InR,|*-* +-¢ — Retm jing) , d=do+d. 


For Ry = 0 and R,, = 1, the function J, takes on the following simple form: 


Zi 1 (d—k)! 1 
In(0,1) = ), ———— | ——___ - — 
m( ) L@apF en (@+m-+ 1)¢-*+1 861) 
Heitor dak jt BP | 
crate Cf ees jfk Dc ON a all 


By analogy with (5.100), the expression for the posterior variance is written as 
D 
F(Re,Ru) | (Re, Ru) 
D[R(t) | t] = ———< _ - | ———+ 
In(Re,Ru) | lo (Re, Ru) 
Later we shall restrict ourselves to the case R; = 0, R,, = 1 corresponding to the absence of 


a priori information. 


5.4.3. Error approximation 


Information about the error of the approximation used for the distribution function can be 
obtained with the help of the above lemma. Due to this lemma, the function F (x; a, 0) 
for (@.@) € Q(4) is situated between the two failure rate distributions. In the following 
theorem we present the methodfor obtaining the TTF, constructed on linear failure rate 


distributions. 


Theorem 5.2. The posterior distribution density hys(r | t) of the TTF R,s(t) = 1 — 


Fs(t, a, B) for given B and uniform prior distribution Rs, satisfies in (0,1) the relation 


d 
his(r|t)~r® D (Bt?) of | Inr|2—*, r€ (0, 1], 
k=0 


where, 


Proof. In accordance with the expression for Fys(t;a@, 8B), we have 


R(t) =exp - ( oe a ar) , (5.102) 


Introduce a new parameterization for F,s(t; @, B), using the parameter r = R(t). According 


to (5.102), 


Inr 8B 
a= oe 


t 


160 Bayesian Theory and Methods with Applications 


Thereafter, we obtain the following relation for the density function of the linear failure 


rate distribution: 
DE oe a igh eee 
fas(x) = (Bx + a)e" 2" = |B (x— =) — | ree BH), 


Using the common expression of the likelihood function (3.20) for the samples derived 


after the realization of NC-plan, we can write 


str | th Ko] [B0 (‘E-5) in| fa (5.103) 


where @ = (1) +) +---+%,)/ty, K(T) is a function independent of r. Transforming the 
product into a sum, we get from (5.103) 


€is(r|t) =K oS Brie i (—Inr) 7. 


k= 
Since the random parameter r is distributed uniformly in the interval 0.1. in accordance 


with Bayes theorem hys(r| 7) ~ zs(r| 7), as desired. O 


Theorem 5.2 lets us find the corresponding osterior pointwise estimate of TTF: 


1 
Ri s(t) =Ris(t3B) =f rhis(r | t)dr= a 


where 


HG) Lipey ioe 


Ot (@+m-+1)¢-H1” 


The relations among the estimates Ry ,(t;B) for different B will be established in the fol- 


lowing theorem. First we introduce a statistic 


Theorem 5.3. Let € > @. Then for any nonnegative B, and Bs such thar By < Bo, the 


relation 


Ris(t; Bi) < Rrs(ts Be) 


holds if one uses as a sample of the testing results the same sample t, and the probability 


Ri s(t) is uniformly distributed a priori in {0,1}. 


Proof. Parameterize the distribution function Frs(x. a. B) using as parameters r — R(t) 
and y = A(r)/A(0), where A(x) - @ + Bx. Itis easy to verify that for B > 0. ¥ > 1 and, in 
addition, the condition B,; < B2 implies y; < y2. Therefore, for the theorem proof it suffices 


to prove that R*(t;y) is a nondecreasing function of y when y > 1. 
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Write the expression for the distribution function F,s(x;a@,B) depending on the parame- 


ters r and y: 


v1) 5424] 


4 


I 
FesGeny) = lan [ 


whence it follows the expression for the density function 


2 (—Inr 
Fis(x:n,y) = i a 


With the help of the obtained expression for the distribution function and density function 


[134] ertlo eet 


of TTF, and the general expression (3.20), we can write the likelihood function, assuming 
that y is given: 

érs(r | t) = K(t,y)(—Inr)? 0”, 
where K(T, y) is a function independent of r, b(y) = eres 


is subjected to a uniform prior distribution in [0,1] and, in view of Bayes theorem, we have 


his(r| t) ~ €rs(r| 7), 


. Since the random parameter 


whence 


Investigating the derivative of the function Ry (ty) with respect to f, we can write 


60)=[1- I | d+1 2(€-@) 
YE bG)+2) CO)F2P OF” 
we observe that for € > @, @(y) > 0, i-e., the function Ry (try) is nondecreasing with 


respect to y. O 


Observe that the condition € > @ is always fulfilled when the highly reliable devices for 
which most of the tests are terminated after the time f is recorded. 

Taking into account Theorem 5.2, Theorem 5.3, and the Lemma, we can draw the follow- 
ing conclusion: the approximate estimate Re obtained for the class So(6) for € > @ lies 
in the interval (6 = [R75 (0:0), Ry,(t:)]). Moreover, the length of the interval is deter- 
mined by the value of the limiting failure rate 6 and the test results. In Fig. 5.12 we present 
the graphs of the functions R*(r) and (5) as functions of the dimensionless parameter 51? 
under the assumption R(t) € [0,1] for different values of sufficient statistics. Beginning 
with some value 6, the estimate Ry s(t) and the upper limit Ry (1:8) remain practically 


unchanged, having achieved their limit values R(t) and Re). The estimate R*(r) is 
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Fig. 5.12 The pointwise TTF estimates and endpoints of the interval j1(6). 


determined by the expressions (5.100) and (5.101) which coincide, as 6 — o. with the 
pointwise estimate of the TTF (5.74) for v = 1. For R¥ ,(t;00) we have 


Z Or+l 
Ree elle = 
Ls ( 9) ou 


corresponding to the pointwise estimate of TTF for the exponential distnbution of the time 
to failure under the condition of no failures. The length of the interval (6) may be used as 
a qualitative characteristic for the approximation of an unknown distribution function. We 
can construct confidence intervals for TTF with the help of the procedure for the posterior 


density represented in § 5.3 by Theorem 5.1. 


Chapter 6 


Estimates of the TTF Probability under the 
Conditions of a Partial Prior Uncertainty 


6.1 The setting of a problem and its general solution 


In the problem of estimating the reliability of many technical devices, we often meet a 
situation which is characterized by incomplete or partial prior uncertainty when the given 
a priori information doesn’t allow us to determine uniquely the prior distribution. 

The following example may be considered as typical for such a situation. We construct a 
system containing model elements produced by an industrial complex. We have catalogs 
with the values of failure rates for each model device. In accordance with the methods of 
Reliability Theory devoted to complicated multi element systems [256], one defines the 
TTF value of the model element during the given time interval. The obtained value is a 
priori for the TTF estimate with respect to a whole complex of the conducted measures and 
doesn’t allow us to form a prior distribution. We need to find a method of estimating TTF 
based on a pointwise a priori value and testing reliability results. Such a method is initiated 
iml2225 2251. 

The theoretical solution of the problem in case of absence of a prior data is known [210, 
257]; here the authors use different modifications of a minimax principle. In the work 
[210] a problem of searching for the optimal solution on the sect of all Bayes solutions, 
corresponding to a definite class of prior distributions, is formulated. In this chapter we 
shall give a solution of the problem for the class of prior distributions conjugated with 
the kernel of a likelihood function. A priori information is given in the form of a set 
of restrictions of the equality and inequality type applied to some functionalisms from 
unknown prior density. These restrictions make practical sense similar to the problem that 


we considered above. 
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6.1.1 The mathematical setting of the problem 


Let a distribution function of a random time-to-failure be given by a parametric family 
F(t) = F(t: 6), where @ is a vector of parameters, 8 (6). @2.... 4,,). Since the problem is 
formulated in the Bayes form, the parameter is assumed to be random. The system testing 
is carried out in accordance with some plan P which gives a censored sample Tt. The testing 
plan P and distribution function F generate a class of prior distributions Hp; , conjugated 
with the likelihood kernel. The following restrictions a replaced on the unknown prior 
density h(@) from this class, that is, 

SiiAGO))< 0.  jrmmmil..2,...2% p. 

S;[A(6)|=0, j=pt+l,...,p+q. 


where S;{i(@)] is some functional, determined by the form of given a priori information. 


(6.1) 


For example, if only a prior value Ro of TTF is known during the time fo. then the set of 
conditions (6.1) are reduced to the equality 

fu — F (1: 8)|h(8)d0 — Ro = 0, (6.2) 
characterizing the coincidence of the theoretical pnor mean value of TTF with Ry. In 
practice, the expressions having the form (6.2) are used most often. 
In the general case, the restrictions (6.1) construct the class of prior distributions generating 
a subclass He). C Hpp. The subject of consideration is some functional Ri Pte character- 
izing the system reliability. In particular, it may be a TTF during some time interval. Then 
R= R(t) = 1—F(r). If a mean operating time is used as a reliability index. the functional 
has the form 


FoF e)= fe — F(1:6)]d?. 


It is assumed that a loss function L(R.R(F(r)), is given allowing us to write a function 
of the posterior risk G(R.h). The problem is to tind the estimate R. minimizing the risk 


function in the class of prior distributions H/7. 


6.1.2 Determination of a class of prior distributions Hp;- 


In accordance with the problem setting, the sample T is censored, i... it is represented by 
the union of two vectors: tT — {t*.r}, where tr = (rp... 1) is a vector of failure times, and 
a (ihe tx) is a vector of censoring elements. In accordance with the expression (3.21), 
a likelihood function for an arbitrary parametric family F(t: @) may be written as 


d Nn 
¢(@ | t) = K(t) [J A(t}; @)exp |— ¥° A(7,:8) 
| 


=i 
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where K(T) is a sample function independent of the parameter 0: 
A(t;0) = F’(t;0)/[1—F(t;6)}, A(t;@) =In{1 — F(t;6)}. 


We have to find, with the help of the expression for @(@ | T), a minimal sufficient statistic 
a = a(P,F) which is defined by the testing plan P and the form of the distribution function 
F.. In the general case a sufficient statistic appears to be a vector @ = (Qj,..., 5) € Qa 


which allows us to write the likelihood function in the form 
£(@ | tT) =co(t)£9(0, a), (6.3) 


where f0(0@,a@) is the likelihood kernel, and the function co(T) is independent of a@ and 
6, and, generally speaking, doesn’t coincide with K(t). In accordance with the theory of 
conjugate prior distributions [202], the kernel of a prior density 4(@) coincides with the 


likelihood kernel, i.e., 
h(@; a’) ~ £9(0; a’), (6.4) 


where a’ = (@),...,@,) is a vector of parameters of a prior density. Also, a’ has the same 
dimension as the one for @, and a’ € Qg. Thus, the class of prior distributions Hp p is 
completely determined by the form of the function &9(@;@) and the set Qa. It is possible 
to broaden this class if one uses a set Qi, such that Qg C Qi, [202]. We can do this, for 
example, by using real parameters in the vector a’ instead of the corresponding integer 
components of the vector @. This method will be used later in 6.2 and 6.3. In the common 


case we assume that a’ € Qi, D Qe. 


6.1.3 Construction of the class Hp 


Since the prior density represented depends on the parameter q’, the restrictions (6.1) are 


transformed into functional inequalities and equalities of the form 


Wea) 0; f= 1,2).5p; (6.5) 
and 

y;(a’) =0, Jap + lyn Pg, (6.6) 
where y;(a@’) = S;[h(@:a’)|, j = 1,...,p +4. The restrictions (6.5) and (6.6) generate the 


set D = D, Dg in the parametric space of the vector a’, where Dy is the set of values of 
the parameter a’ satisfying the equalities (6.6), and D, is the set of values of the parameter 


which satisfy all inequalities (6.5). It is assumed that conditions (6.6) are independent, 1.¢., 
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there are no additional conditions which may be found from these conditions by transfor- 
mations. The analysis of (6.5) and (6.6) shows that, first of all, D is nonempty. Because the 
functions y;(@) are nonlinear in a general case, the analysis of the domain D will be very 
complicated. It should be noted that only for s < q the set of equations (6.6) is unsolvable. 
and the set D is empty. In the general case for s > qg the set D is nonempty. where. for s ~ q¢ 
the set D is countable. 

Introduce a class of prior distributions ah represented by the contraction of the class 
Hpp.The class Hp}: is generated by all prior distributions from Hp- which satisty the ex- 
pressions (6.5) and (6.6), or, is the same as, (6.1). Since the class Hp? is also detined by the 
relation (6.4), the parameter a’must belong to the set Qy = Q),~ D = Qi. The resulting 


formula for the class Hp? is written as 


h(0;a') ~ £9(6;a"), a’ EQ =QUND = h(O;0") € Hp}. (6.7) 


6.1.4 Choice of a prior density from the class H};/ 


If the set D is nonempty and contains more than one point. each of which corresponds to 
a concretely defined prior distribution density, then we are faced with a problem of choice 
of the unique prior density 4.(@) = h(@:a@/). To this end, we will use a posterior risk 
criterion, i.e., 4, (@) will be chosen as a prior density that guarantees the maximum of the 
function of the posterior risk. In other words, the worst prior distribution giving the most 
pessimistic (in the sense of the posterior risk) estimates of the reliability index is chosen. 
Choose some loss function L (R. R) expressing the losses occurred after the replacement of 
the reliability index R[T (1; @)] by the estimate R. With the help of the function LR.R}. the 
function of the mean posterior risk is written as 

G( Rib) = [e@Rro)) h(@ | t)d0, (6.8) 
where fi(@ | T) is the posterior distribution density of the parameter @ = 6. To find f(@— T) 
we apply the Bayes theorem. It yields 

h(@|t)=h(0,a") ~h(0,a') £9(0, a), 
where ais the parameter of the posterior density. Applying relation (6.4) we obtain 

h(0,a") ~ £9 (6,a’) £0(0, a), (6.9) 

For the vector parameters we will use a binary operation a” = a * @ which determines 
the following transformation of two equal functions with different parameters: p(xv.a”) = 
p(x; a’) p(x; at). Using this operation, we can rewrite the expression (6.9) in the form 


h(@ | t) =h(0;a@") ~ £9(0;a' * a). (6.10) 
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If instead of a prior density h,.(@) one uses a distribution density, ensuring the maximum 
of a mean posterior risk, the problem of obtaining the Bayes posterior estimate R* of the 
reliability index can be reduced to the following minimax problem: 

G(R*,h.) = min pe Ge) (6.11) 
Taking into account that h,(@) = h(0; a.) ~ &9(@; a), the problem (6.11) can be reduced 
to a problem of finding the parameter a. Let us denote R(@) = R[F(r;@)]. Using the 


equations (6.8)—(6.10) we can write the mean posterior risk function as follows 
a A 1 A 
G(R.n(0:0)) = Ga(R.a') = 5 [UR R))fo(0:0% a)\d0@, (6.12) 
where f is the normalizing factor of the posterior density. In view of (6.10) we have 


p= (. ly (8;0% a') dé. 
C3) 

Taking into account the obtained expression (6.12), we can reduce the problem (6.11) to 
the following minimax problem: 

Go (R*; a.) =min max G(R, a’). (6.13) 

R deQrq 

For many practical problems, it is very difficult to represent the set Qy = Q),.ND explicitly. 
Therefore, it is more convenient to define a by solving the following conditional minimax 
problem: 


Go(R*,0,) = min Mis G(R,a’), 


wa’) <0, j=1,...,.p, w(a’)=0, j=ptl,...,pt+¢. (6.14) 


6.1.5 Solution of the minimax problem 


When solving problem (6.14) we meet many mathematical difficulties arising from the 
nonlinearity of the functions used. In addition, in some cases we can not write the function 
of mean posterior risk in an explicit form, and therefore we have to use numerical methods 
of integration. The problem is simplified essentially if one uses a quadratic loss function. 


The following theorem is valid for this case. 


Theorem 6.1. Suppose that the loss function L(R,R) = (R- R)*. Then the problem (6.14) 


is equivalent to the problem of finding maximum of the posterior variance. 


Z 
u(al) = f R°(@)n(8: a+ a')40 - [RO n(6:2+ a'y48 (6.15) 
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on the set Qi, under the restrictions 


and 


vi@)=0, joprl,....pra 


Proof. In accordance with the Walde theorem [257], the following equality of minimax 


and maximum takes place: 


min max Ga(R, a’) = max minGa(R, a’). (6.16) 


R a@eQy aleQy 
Consider the problem of minimization of the function Gq (R. a’) for each a’ = Qy for a 


fixed value of the sufficient statistic @: 
Ga (Rt, 0) = min f £(R,R(0))h(O;a+ a") dO. 
Rk JO 


The solution of the problem for the quadratic loss function L(R.R) = (R— Ry is repre- 


sented by the posterior mean value 
Rt = L R(0)h(0; 0 or)d8, (6.17) 
(o) 


which gives the following posterior risk function: 


A 


Golkee ) = min [ [R(@) — R*] h(0;a% a’)d@. (6.18) 
9 
The estimate (6.17) is conditionally optimal, i.e. it enables us to find the posterior mean 
value of a TTF for a given @’. Substituting the expression (6.18) into (6.14) and taking 
into account the expressions (6.16) and (6.17), we obtain the following formulation of the 
problem: 
: ' aa 
Gal’ vo’ \=aimax | [,#@ynoia a = | R(O)h(O:a*a@ d6| ! 
AEX, | /O JO | 
We 0. f= line, (0; eee lees p+4q, 

which proves Theorem 6.1. In order to obtain the Bayes lower confidence limit Ry with 


given a, we need to solve, in accordance with (2.34), the equation 


i h(0; 0. a')d0 —y =0. (6.19) 
JR(@ 


>=Rt) 


oy 
O 
Formulation of the problem (6.14) together with the equation (6.19) gives us the method of 
obtaining TTF estimates. These estimates are called conditionally minimaximal in view of 


the special form of the problem arising from the estimation method. 


Estimates of the TTF Probability under the Conditions of a Partial Prior Uncertainty 169 


6.2 A partial prior information for the Bernoulli trials 


6.2.1 Formulation of the problem 


Consider the following testing plan Pz. n devices are being tested having a single-use 
purpose. Each device during the test period has a capacity for performing with a constant 
probability p and fails with a probability 1 — p. The unknown quantity p will be considered 
as a parameter in the interval of admissible values [0,1]. Assume that during the testing 


d > 0 devices fail. The likelihood function for the subject scheme has the form 

&(p:n,d) = C) p41 — p)4. (6.20) 
In this case the following beta-distribution plays the role of a prior distribution conjugated 
with the likelihood kernel (6.20), that is, 


a—-1(] _ p\B-! 
hp) = h(pia,p) == 


where B (a, 8) is a beta-function. Note that in the subject case the expansion of the class of 


a >0, B 20, (6.21) 


a conjugate prior distribution takes place because the sufficient likelihood statistics are inte- 
ger constants, and parameters @ and f are real numbers. Let us denote the beta-distribution 
with the parameters @ and B by Be(a, B). 

Consider the problem of obtaining the TTF R = p which, in the given case, will be out- 
of-time characteristic, under the conditions of a partial prior uncertainty, expressed in the 
form of a single restriction. Let us assume that at first a prior TTF value Ro is known. This 


condition has the following mathematical interpretation: 


[prt v:a.,B)ap = Re. 


After integration 
O 


—— = >. 
a+ Bp 2 
The posterior distribution, corresponding to the likelihood (6.20) and a prior density (6.21), 


is Be(a+n—d,B+d). 


In order to find optimal values a, and B, of the parameters of a prior density h,(p) = 


(6.22) 


h(p;a.,B,.), we will use the quadratic loss function L(j,p) > (p— p). In view of Theo- 
rem 6.1, the problem is reduced to the minimization of the function of the posterior variance 


| yatn—-d-1(y — x)B+a-| | 1 atn-d-1( — x)B+d-1 
0 


U(egp= ) Batre Bee B(a+n-—d, B +d) 


under the restriction (6.22). Carrying out the calculations, we obtain 


_ (a+n—d)(B +4) a 
TOP) BONS a+ Be m(at B+) +B 


— Rua. (6:23) 
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6.2.2 Peculiarities of the problem solution 


Let us clarify some characteristics of the problem (6.23) useful for applications. At first 
we will investigate the case when there is no information about experiment outcomes, 1.e.. 
in the problem (6.23) n — d = 0. This, and other cases in which we are interested. will be 


formulated and provided when it is necessary. 


Theorem 6.2. Suppose that the posterior variance is represented by the formula 


" ap 
ONG) eames a ane 


Then the point (a.,B.), corresponding to maximum of the function U(a.B) under the 


Ce PS. 


restriction @/(a+ B) = Ro is (0,0) for any Ro. Moreover, the maximum value of U will be 
Ro(1 — Ro). 


Proof. Introduce the variable z = @ + 8. With the help of this variable and the equality 
a/z = Ro, the function U(a@, B) may be written as 
, _ Ro(1 — Ro) 
F(z) =U(a,p) = ————. 
(2) = U(a,B) = 
Since a > 0, B > 0, one has z > 0. The function F(z) in the domain of its nonnegative 
values has a supremum at the point z ~ 0 equal to F(0) = Ro(1 - Ro). Taking into account 


our assumption @ = Roz for z = 0, we obtain a = B = 0 as was desired. = 


Due to the proved property, the optimal values of the parameters @ and B. in absence of 
experimental data are independent of the a priori value of TTF Rp. and the desired TTF 
estimate equals the, prior one Ro, and has the variance Ro(1 — Ro). 

Consider now the more general case n > 0. The solution of the problem (6.23) for this case 


is represented by the following statement. 


Theorem 6.3. Suppose the function of the posterior variance of the index Ro is written as 


(a+n—d)(B +d) 
(a+B+n)2(a+B+n+1) 


fora >0, B >0,n>0,d > 0. Then the function U is monotonically decreasing along any 


U(a,B) = 


straight line of the form a/(a+ B) = Ro, if the following inequality holds 


(= -e) (q-=) >0, - (6.24) 


where 
a 4 (CEG oa) ea) 
n—d (n—d+1)(n—2d)—2d? © 


(6.25) 
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Proof. ntroduce the variables x + @ +m, where m = n—d, and y = B +d. The function 
U(a, B) changes into 
xy 


ie Gea ty + ee 


Se = ith, ce Ge 


In view of Theorem 6.2, the function U (x,y) for x > 0, y > 0 is monotonically decreasing 
along any straight line of the form y = px for p > 0, and attains its maximum at the point 
x =y=0. At the same time, the absolute maximum can’t be attained at the point x = y = 0, 
i.e., the point (0,0) is an isolated singular point. It is easy to prove that U(x, y) < 0.25, for 
all x > 0, y > 0. Investigate the function y = (x) obtained in the result of cross-cutting of 
the function z = U (x,y) by the plane z = h (for h < 0.25). The implicit form of the function 
y = (x) is F(x,y) = xy —h(x+y)?(x+ y+ 1) =0. The point x = y = 0 is a node for the 
given function, since A = F/\*(0.0) — F/,(0,0)F, (0,0) = 1 — 4h > 0. It is easy to check 


also that the function y = @(x) is symmetric with respect to the straight line y = x. In view 


of the mentioned properties, the function F(x, y) = 0 has the form shown in Fig. 6.1. 0 


In order to find the form of the function represented by the implicit equation U(a, B) = h, 
we have to transfer the origin into the point x = m =n—d, y =d. As seen from Fig. 6.1, 


the function U(a@, B) will not be monotonic along any straight line of the form 


The monotonicity domain is ended by the tangent to the equal-level line U(a,B) = h at 
the point a = B = 0, or is the same, to the equal-level line U(x,y) =h at the point x = m, 
gad: 
We proceed to find the slope g of this tangent. By definition, 
! 2 

Nae oe (6.26) 
As seen from Fig. 6.1, for m > d (n > d/2) the function U(a, B) will be monotonically 
decreasing along any straight line whose slope doesn’t exceed g. For m < d (n < d/2), 
vice versa, the function U(a@, B) is monotonically decreasing along any straight line with 


the slope which is greater or equal to g. In other words, the monotonicity condition for the 


function U (a, B) along the straight line @/(a@ + B) = Ro takes on the following form 


1—Ro . n 
——<g, ifd<-, 
mS 2 
and 
1—R 
Se if d> <=, 


Ro 2 
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Monotonicity Domain 
n>d/2 


0 m(n<d/2) nine 2) x 


Fig. 6.1 Curves with equal levels for the function U(x. y) and U(a@. B). 


which may be written with the help of (6.24). 


In view of this theorem we can easily obtain the following two corollaries: 


Corollary 6.1. The solution of problem (6.23) under the condition (6.24) is independent 
of Ro, and is written as a, ~ B, ~ 0. The posterior Bayes estimate for this case coincides 


with the maximum likelihood estimate: 


Thereby the Bayes conditionally minimax estimate may ignore a priori information, if the 


last one contradicts the results of testing. 


Corollary 6.2. For completely successful tests (d_ = 0), the condition of monotonicity (6.2) 
is never fulfilled. 
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The following statement establishes the relationship between the Bayes and maximum like- 


lihood estimates. 


Theorem 6.4. Suppose the condition (6.24) is not fulfilled and the solution of the prob- 
lem (6.23) differs from the trivial one. Then the Bayes pointwise TTF estimate R* for the 


quadratic loss function exceeds the maximum likelihood estimate, if Ry <1 —d/n. 


Proof. The Bayes estimate R* for the quadratic loss function coincides with the posterior 


mean value, that is, 


Investigate the behavior of the function R* (a, B) along the straight line a /(a@+ B) = Ro. 
To this end, we express R*(@, B) as a function of a single variable a: 
pK Qin-d @ 


_ Gand 
a+Bp+na+B 


=n} == R(a,B) = (0) = 


The derivative of the function @(a) will be 
med te (1—Ro)n 
Ro (¢ + n) 
As seen from the last expression @’(a) > 0, if Ro > | —d/n, and @’(a) <0, if Ro < 1—d/n. 
Therefore, since @, > 0, under the condition Ro > 1 —d/n, we have 


d 


- ° 


o' (a) 


R* (a4,, Bx) = 6 (a4) > 9(0) = 1 ~ 
Otherwise, i.e., when Ro < 1 —d/n, we have 
* d 
R* (a, Be) = $(%) < 90) =1~—. 
and the theorem is now proved. i) 


If the condition (6.24) is not fulfilled, the problem of obtaining optimal values of the pa- 
rameters a, and B, can be reduced to the solution of a cubic equation. Introduce a new 
variable z= a+ {8-+n. After this the problem (6.23) represents by itself the problem of 
finding a maximum for the following function of variable z: 

_ (Ro(e—n) +n=d)[(z—n)(1—Ro) +4} 

7 z2(1+2) , 


Applying Calculus methods to the last problem we arrive at the equation 


Tz) 


D+Az2+Bz+C =0, (6.27) 
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where 
gO) an mee seo) 
Ro( ¥ = Ro) Ro(1 — Ro) (6.28) 
C= and s=n(l—Ro) —d. 


~ Ro(1—Ro)’ 
The equation (6.27) has a single root z, in the domain z >n. Thereafter we obtain the 


resulting expression for the parameters @, and f,, that is, 


a, = (z.—n)Ro and B, = (z,—n)(1—Ro). (6.29) 


6.2.3 A scheme for evaluating TTF estimates 


A prior pointwise estimate of TTF Ro, the total number of tests n and the number of failures 
d are the input data for calculation. The following scheme will be applied for finding 


pointwise estimates R* and Og. : 


a) By the formula (6.25) we find the slope g of the tangent and verify the condition (6.24) 
b) If the condition (6.24) is fulfilled, then we evaluate the desired estimates 
eee ce Ope = 
n n-(n-+ 1) 

and the algorithm terminates. Otherwise we pass to the next step. 
c) With the help of (6.28) we Bud the values of the coefficients A. B. C and solve equation 

(6.27) in the domain z > n. Having solved the problem, we obtain the single root z.. 
d) Using (6.29) we obtain the optimal values of a,, B.. 


e) Calculations are terminated with 


i (a, +n—d)(B.+d) 
Re = —_—_— se = ——— : 
+B. +n? oR (o% +B. +n)*(a4+ B,+n+1) (ae?) 


6.2.4 Numerical analysis for TTF estimates 


Consider the case of non-failure testing (d ~ 0) frequently exploited in practice. In Table 
6.1 we represent the graphs of dependence of the parameters o.. B, on the number of tests 
nand a prior value of TTF Ro. 

As scen from Table 6.1, the estimates of a. B, for the constant value of Ro change pro- 
portionally, and in addition, a, and B, increase together with the increase of n and Ro. 


In Figures 6.2 and 6.3 we represent the dependencies of the estimates R* and Og on the 
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Table 6.1 Optimal values of the parameters of a prior distribution (the first number is O,, 
the second is B,). 


Homogeneous data 


ee 0.9732 0.9740 0.9753 0.9787 0.9755 
» 0.9740 0.9751 0.9788 0.9753 0.9761 
4 | 09737 0.9760 


Nonhomogeneous data 


0.9732 0.9740 0.9753 0.9787 0.9755 
0.9740 0.9779 0.9744 0.9773 
0.9729 0.9749 0.9735 0.9731 0.9761 


number of tests and a prior value of TTF Ro. They demonstrate the behavior of approxima- 
tions of prior estimates. We can see that as n — oo the estimate R* tends to the maximum 
likelihood estimate, and for d = 0 tends to 1. However, as it is seen from Figure 6.2, the 
convergence rate depends substantially on a prior value of TTF. The same conclusion may 


be drawn for the posterior mean-squared value. 


6.2.5 A different way to calculate a lower confidence limit of TTF 


In accordance with the definition, the estimate Ry is defined by the equation 


| 
[. R(ese.,B..n.d)dp~1=0, (6.31) 
i 


where h(p) is the posterior density of the beta-distribution, given by the expression 


0 ad pe tA re | — p)P tdewl 
B(a +n—d, Bx +d) : 
The first method for obtaining the estimate Ry is based on the numerical solution of the 


O<p<l. 


equation (6.31) for the function A(p). Unfortunately this method has a disadvantage. For 
large values of TTF (R > 0.99) and d = 0, the posterior density is concentrated in a very 
small neighborhood of the point p = |. Because of this we can meet serious calculation 
obstacles: the error of numerical integration may be large. 

The second method is based on the known results about a completely defined binomial 
scheme. The use of such a method is possible because of the following fact: after determi- 
nation of the parameters a, and f,, the considered scheme will be completely determined. 


Due to this reason, satisfies the relation [ 120): 


B. +d ai 


Ry = [1+ SoG Fin 2tBeta)i2(aetn—d)| (6.32) 
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0.96 


0.92 


Fig. 6.2 The posterior pointwise TTF estimate. 


where F5.,,,. is the 100 6-percent point of the F-distribution with v;. v2 degrees of free- 
dom which is found from the tables [160]. The difficulties arising from practical use of the 
expression (6,32) are characterized by the following: even the fullest tables [160] contain 
the values of percentiles of the F-distribution beginning with the value of the degree of 
freedom vy; 0.1. At the same time, if we carry out the practical calculations for highly 
reliable devices, we need to have the percentile values for vy < 0.1 (see. for example, the 
data from Table 6.1). In Table 6.2 we represent the calculated values of the estimate for 
different n and Ro. It is easy to see that Ry increases more rapidly in comparison with R 
as Ro and n increase. 

We present a third method to obtain approximate estimates of Ry. It is based on the ana- 


lytical change of the posterior density fi[p] by the density = corresponding to the prior 
Alp) 
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Fig. 6.3 The posterior mean squared value of a TTF. 


scheme. The corresponding conditions for h and a is written in the form of equality of 
(p) 


their first times 
I 1 
[ pr(p)ap= | ph(p) dp. 


Taking into account the above assumptions, we obtain 


c—] 


Pp 
B(c,1)’ 


where c = R*/(1 — R*). Then (6.30) may be rewritten as 


] 
i h(p)(p;c, ljdp—y = 9, 
Ry 


apa. (6.33) 


h(p) = 


and thereby we can obtain the analytical solution 


RY =(1—y)"". (6.34) 
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Table 6.2 The values of the lower Bayes confidence limit of the TTF. 


(1.9188 0.9432 


().9237 0.9523 


0.8690, 


0.8789 0.9282 1) 9533 


0.9315 (),.9548 


0.8861 


0).9340 9.956] 


0.9880 


0.98817 
0.98824 


0.98829 


0.9992 0.9994 0.9996 
0.9990438 0.9992888 0.9995217 | 
0.9990574 0.9992929 0.9995286 


0.9988048 
0.9988259 


Table 6.5 Approximate values of Quo for hghly-reliable devices. 


Ro 


1.1952. 1073 9.562- 10-4 Tlg2aio-* 


1.1784-1073 | 9.426-10-4 


In Table 6.3 we represent the values of Rj y. obtained with the third method, for different Ro 
and n for tests with no failures. Comparison of the data from Tables 6.2 and 6.3 characterize 
the exactness of approximate methods. 

In Table 6.4 we give the values of Rj, for d = 0. 


Representation of the final result in the form of the lower confidence limit Qy of the prob- 
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ability of failure is more observable. In Table 6.5 we represent the values of Qo.9 corre- 
sponding to the data from Table 6.4. 

The results, represented in Table 6.5, are more suitable for applied analysis for the follow- 
ing reasons. What matters is that for large values of TTF (greater than 0.999) the values 
of the estimates we obtain are slightly distinguishable from the point of view of traditional 
numerical methods (the values differ beginning only with the fifth digit). At the same time, 
if one uses for the purpose of comparative applied analysis, a probability of failure, then 
the differences among the estimates will be more essential (beginning with the first valu- 
able digit). In accordance with this, it should be more preferable to define the confidence 
requirement in the form of a probability of failure Q,eg which must be ensured with the con- 
fidence level y. As a corollary of this, the procedure of control of the achieved confidence 


level must be established in accordance with the condition Oy < Oreq: 


6.2.6 Comparison with known results 


Next we consider the following example, touching upon the estimate of TTF by the results 


of natural tests, and give its solution using different methods. 


Example 6.1. From a priori information we know a prior pointwise estimate of TTF 
Ro = 0.9576 and its error characteristic Or, = 0.0333 during the experiment 12 tests with 
no failures of the device have been carried out. We need to estimate the TTF with the 


confidence level y = 0.9. 


Solution. Since Ro and op, are given, the considered scheme is completely defined. De- 


termine the parameters of a prior distribution @ and f by the following known formula: 


a=Rop, B=(1—Ro)p and p= ar — Ro)Ro — 1. 
0 
For the initial example data we have a = 19.97, B = 0.499. Putting a, = a, B, = B in 
(6.31), for n = 12, d = 0, we obtain R* = 0.9846, Og, = 0.0213. With the help of tables 
[160] we find the corresponding percentage point of the F’-distribution: Fo.1.0.998.64 ~ 2-79. 
Thereafter by the formula (6.32) we find the lower confidence limit Ro 9 = 0.9583. Note, 
by the way, that for ensuring the confidence level Rreg = 0.9583 without using a prior 
information, it would be necessary to carry out 54 tests with no failures. 
Consider another example where the scheme of estimating TTF doesn’t have a complete 


prior definiteness. 
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Example 6.2. The data of this example are almost the same as those in Example 6.1. except 


that the condition 6g,,is unknown. 


Solution. Thus, we have a scheme with a partial prior definiteness, scrupulously investi- 
gated in the preceding section. Return to Section 6.2.3. Since d = 0, we have g = 0 and 
therefore the condition (6.24) is not fulfilled. Consequently, to find the optimal values of 
the parameters a, and B,, we need to solve the cubic equation (6.27). Using formulas 
(6.28) we get the value of the equation coefficient A = —22.94. B = -30.60,C = —12.75. 
Solving the cubic equation we obtain z, = 24.22. With the help of (6.29) we calculate 
the optimal values of the parameters: o = 11.92, B, = 0.52. Evaluation of the TTF esti- 


mates is carried out with the help of expressions (6.30) and (6.32). Finally. RX = 0.9788. 
Og. = 0.0286, Rj g = 0.9425. O 


Let us compare the solutions of Example 6.1 and Example 6.2. At first. the TTF estimate 
obtained in the first case has an error less than the one for the second case. Such a con- 
clusion is unavoidable, since the first calculation scheme is completely a priori determined. 
Therefore, estimating the reliability in the more general case of a partial prior definiteness. 
we lose in the exactness of obtained estimates. This can be considered as the price we 
have to pay for the solution of the problem in the more general case. Later. the estimate 
Ry in the second case appeared to be less, and consequently, to ensure the same reliability 
level under the conditions of a partial prior definiteness, we need to carry out more tests 
than have been done earlier. This may be also interpreted in other words: lack of a priori 
information is compensated by additional data. 

In conclusion, we note that the winnings in the number of tests. in companson with the 
traditional Bayes approach, remain more valuable in the case of realization of the scheme 
with a partial prior definiteness. Thus, in the conditions of Example 6.2 for ensuring the 
reliability level Rreg = 0.9425 in the case of absence of a priori information, we need to 
carry out 39 tests without any observed failures, against 12, under the assumption that the 
value of Ro is known. The gain is three times as much as it was earlier. The greater the 


required values are, the more precise our end result. 


6.3 Partial prior information for the constant failure rate 


We will assume that the random time to failure obeys the exponential distribution with the 


function 


F(t)=F(t:A)=1-e™, 1>0, x30. (6.35) 
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The tests are carried out in accordance with the plan giving the censored sample t = ome, 
where f* = (t},...,17) is a sample of failure moments, and t = (t),...,t«) is a sample of 


censoring times. 


6.3.1 A problem of estimating TTF, R(t), for an arbitrary time 


Suppose that as a priori information is used a prior value of TTF, Ro, for a given fg. We 
have to find the estimate of R(t) for the time 7 different (in a general case) from fo. The 
solution of the problem will be obtained in accordance with the approach given in § 6.1. 

Taking into account the general relation (6.3), we write down the likelihood function for 


the parametric family (6.35): 
0(A|t)=K(t)A4%e™*, d>0, K>0, (6.36) 
where K = 7%] +---+ 7, is a total test operating time. In view of (6.36), we conclude that 


the following density of a gamma-distribution with some unknown parameters s and € is a 


conjugated prior density for the parameter A: 
est 
h(A) =h(A;5,€) = Mom, 2 <0ms > 0, 6.3 
(A) = h(Ass,e) = Fae 550 (6.37) 


or, in a brief form, we will note that A fits the distribution [(s,€). The parameter s, in 


contrast to d, 1s real, i.e., we meet the expansion of the range of the sufficient statistic 
(d,k). In accordance with the Bayes theorem (d.k) * (s,€) = (d+s, K +€), thereby the 
posterior distribution for A will be [(d+s, K +€), ie., 


d+s+1 
h(A | t) =h(d,s,K,€) = aero. (6.38) 


The parameters s and € are unknown. Define their optimal values s, and €,, using the mini- 
max principle given in § 6.1. Choose a quadratic loss function and apply Theorem 6.1. The 
problem of calculating s, and €, is reduced to the maximization of the posterior variance of 


the function R(t) = | — F(t) under the restriction on the prior mean value of this function: 
9 


Ves 
co 


Un(s,e) = f R(nA)Kwid.s.K.e)da— J RU:AyNAd.Ke)aa enti! (6989) 
0 0 


[ RltvsAyn(Ass,e)dd = Ro. 
0 


Having carried out some calculations, one can rewrite the problem (6.39) in the final form 


d+s+] 2(d+s+1) 
_K+e = (A , (6.40) 
K+eé€+2r K+e4+t 


As in the preceding paragraph, we come to the problem of the conditional maximum which 


U (s,s) as 
Bee 


can only be solved using numerical methods. 
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6.3.2 A problem of estimating the failure rate 


Let us change the problem in the following way. First, suppose that we have to estimate 
the parameter A, and thereafter, with the help of the obtained estimate. find the estimate of 
TTF R(t). As before, we will use a quadratic Joss function and Theorem 6.1. As a priori 
information, we will choose a prior value of the failure rate Ay, i-e.. the restriction of the 


problem will now be written as 
[ amtass.eydd =o. 
0 


or, after substitution of 6.37, and further integration, we have 


= =a (6.41) 


Let us write the function of the posterior variance of the parameter A as a function of the 
unknown parameters d and €: 


2 
wast | 
kee 


Taking into account the expressions (6.42) and (6.41), in accordance with Theorem 6.1. we 


trices [ Valaid.s.ke\aa é. [ff antaca.s.kelda (6.42) 


represent the problem of finding optimal values of the parameters €, ands, in the following 


form 
d+s4+1 st+l 
Ua(se.€.) max UG (sae) — ———, — =~. 6.43 
aS es En) eS ret aaa (k+e)2 cia Me) 
€>0 €>0 


The problem (6.43) may be solved analytically. 


6.3.3. Solution of problem (6.43) 


Taking into account the restrictions of the problem. we have € ~ (y= 1) Ap. Detine a 


function 


a Sol Woe aed 
o(s) 20; (s.3*) = s20 


whose greatest value corresponds to the solution of the problem (6.43). Its derivative is 


given by 
sp Cacao is 
i aaa 5 rg ee 
for s > 0. It is easy to see from (6.44) that the condition 
2d +1 
ie) eae : (6.45) 


implies the nonpositiveness of the derivative @'(s) for s > 0, where the function @(s) is 


monotonic as s > 0 and reaches its greatest value at the point s. = 0. Otherwise, the 
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function @(s) has a single maximum at the point s, = Agk — 2d — 1. Thereby, the general 


solution of the problem (6.43) takes on the form 


1 - 2d+1 
yn? if < 
Io Ao 


(aok—24—1, k- =), if Ag > 


0, 


2d+1 (oo) 
- 
With the help of the obtained values s, and €,, we find the posterior estimates of the failure 
rate in the form 
me fl oohocall pe ig er 
A = ———.— and o,, = —__—_. 
k+ & Ore) 


In order to find the upper confidence limit, we apply the results of the work [120] for a 


(6.47) 


completely determined scheme with a constant failure rate. Then 


a A ee 
hy = 


where 72. is the 100@ percent point of the 7? distribution. 


6.3.4 Estimation of the TTF with the help of the failure rate estimates 


When the parameters s, and €,, defined by the expression (6.46), are unknown, the pos- 
terior density of the parameter A (6.38) is determined. It enables us to find, without any 


difficulties, corresponding TTF estimates R(t) = 1 — F(t;A) = exp(—Avr). In particular, 
R(t) = [ MA(Asd, 54k, €x)dA 
0 


=. (k+ ae aaa 
~ T(d+s.4+1) Jo 


7 (k+ encase t! 0° ZAtSE eZ dz 
~ V(d+s,+1) Jo (k+e,+1)¢t 


7 k+eé, d+s4+1 
~ \k+e,+t 


For the posterior variance 02... we apply a similar scheme. Introduce dimensionless pa- 


(t) 
rameters 


u, = (€&+k)/t and vy. =s,4+d. (6.49) 


Thereafter TTF estimates may be rewritten with the help of the following simple formulas: 


7 Vat 
R= ( —) (6.50) 
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Table 6.6 Bayes estimation of TTF with testing without failures R*(ty)/Rj (to). 


0.9996 | 
0.99960045 0.99980003 
0.99907984 | 0.99953951 
0.99960105 0.99980023 
0.99908 134 0.9995399 | 
0.99960165 0.99980033 
0.99808284 [_ 0.9995403 1! 


0),9998 


0.99920153 
0.998 16168 
0.999204 13 
0.998 16746 
0.9992066 
0.9981733 


0.99940095 
0.99862060 
0.99940235 
0.99862388 
0.9994038 
0.9986272 


and 


For the estimate R¥ the relation P{ R(t) > Ry(t)} = P{Ay <A}. holds. whence 


2 
X1_7,2(d-+5.41) 


Ry(t) = exp ae 


(6.51) 
The estimate R}(1) also may be found with the help of the equation (6.19) which for the 
given case takes on the form 


| h(A.d.s,.k.e.)\dA —y = 0. 
eaeer(r) 


and may be rewritten as 


u a1 
(Ry (1) ie re lingy()|"| = 1-7. (6.52) 


This equation is recommended for the estimation of a TTF as a compound part of some 
numerical algorithm when it is inexpedient to use the table values of the percent points of 


the chi? distribution. In the case d = 0, (6.52) has a simple analytical solution: 


R(t) =(1—y)'". (6.53) 


6.3.5 Numerical analysis for TTF estimates 


In Tables 6.6 and 6.7 we represent the results of calculations of TTF estimates by the 
formulas (6.50) and (6.52), depending on a prior value Ro - R(to) and reduced testing 
statistic @ = k/t. Calculations of TTF, carried out for the time f = fo, allow us to ebserve 
the evolution of the posterior estimate R*in accordance with the character of empirical 


data. Comparing Tables 6.6 and 6.7 we conclude that for d = 1, TTF estimates are less 
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Table 6.7 Bayes estimation of TTF with one failure R* (to) /R% 9. 


0.9990 0.9996 0.9998 
0.99880226 


0.99689645 0.99767 105 0.99844630 0.99922240 

0.9969065 0.9976767 0.9984488 1 0.9992231 
0.9984 1387 0.99920346 0.9996007 | 

0.9969 1900 0.99768205 0.99845 125 0.99922370 


than corresponding estimates in a testing without failures. The increasing of @ and Ro 


induces the increasing of TTF estimates. 
In Tables 6.8 and 6.9, we present the results of the reliability calculations which depend on 
the probability of failures. As in § 6.2, we again deal with a visually and practical form of 


representation to obtain reliability estimates. 


6.4 Bayes estimates of the time to failures probability for the restricted 
increasing failure rate distributions 


In Chapters 3 and 5 we have used as a priori information the intervals of prior uncertainty 
of the estimated parameter. It is assumed also that the estimated index or parameter lies 
in the indicated interval with the probability equal to |. Superfluous categoricity of the 
assertion about the domain of possible values of the parameter is the main drawback of this 
method. In this section, we will investigate a modification of the method of representation 
of a priori information in the form of the interval of a prior uncertainty. The essence of 
such a modification is interpreted as follows: the indicated interval of a priori uncertainty 
contains the estimated parameter with some probability  < I, 1.e., it doesn’t appear to 
be completely ensured. Such a form is more preferable because it is less categorical. If 
one uses conjugated prior distributions, then the reliability estimates belong to the class of 


Bayes conditional minimax estimates. 


6.4.1 Setting of the problem 


Let a TTF of the investigated device obey the probability distribution with a function 
F(t;0), where @ € Q is some vector parameter. The parameter @ is distributed in ac- 


cordance with a probability density h(@) which is unknown. As a prior information is 
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Table 6.8 Bayes estimation of TTF with failure free testing QO” (#9) /Q5 y{to). 


0.9992 


Ry 


0.9994 0.9996 0.9998 
5.990. 10-4 | 3.995- 10-4 2.001- 10-4 
1.379-10-3 | 9.202-10~4 4.605- 1074 
5.976-10 4 3.989-10 4 1.988 - 10-4 
10-3 9.187-10°4 | 4.601-10-4 
5.962-10 4 3.983.104 1.997-10~4 


Cine 


TOSI 
1.833. 10 


1.376 - 


7.934 - 10 
1.827-10 


5.990.10-4 
1.379 -10 


7.985: 1074 
1.838- 1073 
7.959.1074 
1.833-10 * 
7.934.110" 
fea7= Oe 


V7) - Opes 4597 a0" 


used, a pair (O, 1), where © € Q, and p € [0,1], satisfy the relation 
fi h(0)d0 > p. (6.54) 
JO 


Definition 6.1. The set @ C Q will be called a Bayes prior confidence set. if it satisfies 
the relation (6.54). In the case of a one-dimensional parameter, the interval © = (6'.6"" is 


called a prior confidence interval. 


We will assume that tests are carried out by the NC-plan and we have obtained the sample 
tee {t",t}, where't” = (t],....7)) isahe-veetorot failure timeswand tt ft, ..... tp) is the 
vector of standstills of tests which are not connected with a failure. The problem is to Bud 


the posterior estimate of TTF R(t) = 1 — F(r) for the quadratic loss function. 


6.4.2 General solution of the problem 


Taking into account the restriction (6.54) imposed on a prior density, we can draw the 
following conclusion: the considered problem coincides with the problem of estimating 


TTF under the conditions of a partial prior definiteness. As was the case in a general 
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solution (see § 6.1), we will use a conjugate a priori distribution, whose kernel coincides 
with the likelihood kernel 


h(@) = h(0; a’) ~ £9(0; a”), (6.55) 


where @’ is a vector of parameters of a prior density, and €9(@; @’) is the likelihood kernel 
written with the help of the general formula (3.20). 

Later on we will use the general (for the class of Bayes estimates under the conditions of a 

partial prior definiteness) principle of a choice of the parameter a’ which leads, in the final 

form, to the solution of the minimax problem (6.14). Substituting the expression (6.55) into 

(6.54), we arrive at the following partial formulation of the problem (6.14) for obtaining 

the Bayes estimate R* and the vector of parameters of a prior density a 

G(R, ol) = np ht (R, sin ax a')d0, 

(6.56) 

9(0;0")d0 > uf, £9(0; 0) 

Given below are two cases frequently encountered in practice: the first one has an expo- 


nential distribution F(t; @), the second has a binomial. 
6.4.3 Estimate of the TTF for the exponential distribution of the time-to-failure 
Let F(t;A) = 1—exp(—Ar), A > 0; we need to estimate the TTF 
R(t) =P{E >t} =e™ (6.57) 
under the condition that given prior -confidence interval [R;,R,,] such that 
P{R;, < R(to) < Ry} > wh, (6.58) 


where, generally speaking, to #f. The results of testing are represented by the parameter 
T, introduced in § 6.1. 

Let us find first a prior distribution for A. In view of the monotonicity of the dependence 
(6.57), a prior confidence interval for A has the form [A',A”], where A’ = —InR,,/to, A" = 
—InR;/to. By the definition of a prior confidence interval, for a prior density h(A) of the 


parameter A we have 
7M 
"A(A)dA > p. (6.59) 


For the exponential distribution, a prior density h(A ), conjugate to the likelihood kernel, is 


represented by the formula (6.37). The final formulation of the problem of finding optimal 
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values of the parameters of a prior density s. and €, and, in view of (6.56), is written 


similarly to (6.43) 


d+s +1 
UNS.,6.) = max (sé) =n 
Se a (U6 1 ee (6.60) 
” . (s+ 1) : 
A 
Afe lea sa 


dy! e 
where k = tT +---+,, and U(s,€) is the posterior variance of the parameter. 
The problem (6.60) belongs to the class of problems of Nonlinear Programming. and can be 
solved only numerically with computer tools. For the approximate solution of the problem 
(6.60), we consider the so-called case of tests without failures which can be associated 
with a highly-reliable technical device. This case is introduced by the condition s. = 0. 
since the parameter s has the sense of the prior number of failures that occurred during 
the total operating time €. Suppose also that R(t)) € [R). 1. Thereby it follows A‘ = 0. 
A” = —1nR;/to. The problem (6.60) takes on the form 

Ue) =U06)= max [ e “das .. (6.61) 
Since the parameter € is continuous, the solution of the problem (6.61) belongs to the 


boundary of the domain of admissible solutions. i.e., it is defined by the condition 


Re leat 


or 
In] — #1) 
, = ——— fo. : 
€ ink, 0 (6.62) 
After we apply the formula similar to (6.50), we have 
d+l 
Z Fe he pals 
R* t)= i -, j 
(1) (—} sects ee (6.63) 
and 
d+ 2(d+1) 
zs uy Uy 
Cpu) = = : 6.64 
R*(t) (5) () (9.84) 


For the lower Bayes confidence limit, we recommend the use of the formula (6.51) with 
s, = 1. In Table 6.10 we present the estimates TTF. obtained by the formulas (6.62)— 
(6.64), and (6.51) tor different values of characteristics of a priori information R, and L 
and experimental data, expressed by the staustics @ ~ k/to) and d — 0. For each comput- 
ing variant we determine three estimates R*. Op. and Rpg. situated successively one after 
another. As can be seen from the table, the TTF estimates improve as the prior confidence 
level increases: the pointwise estimate and confidence limit increase while the posterior 


mean-squared value decreases. 
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Table 6.10 Bayes estimation of TTF with one failure Q* (#9) /Q} 9 (to). 


3.103. 1073 1.329-1073 1.554- 1073 7.776: 1074 

1.591- 1073 1.195-1073 
TSoiesl0-" 7.770: 10 4 
4 


Ro 


3.094 - 1073 2.323 -1073 
1.596- 107? 1.192-1073 7.965 - 107 3.993. 10~4 
3.081 -1073 2.318-1073 1.548-1073 7.763-10 4 


6.4.4 The TTF estimate for the binomial distribution 


Consider a case of independent tests, when the results are fixed in the form “success or 
failure’ and represented in the final form by the total number of tests n and by the number 
of failures d. The likelihood function for the considered scheme has the form (6.20), and 
the beta-distribution with the density (6.21) plays the role of a conjugate prior distribution. 
The common minimax problem of finding unknown parameters of the a priori distribution 
a, and B, and TTF estimate, R = p, in the given case will be formulated as 


1 
G(p*;., 8.) = min max | L(6,p)p" 4° ""(1 —p)**8 “lap, 
0 


p aso 
B>0 (6.65) 


Ru 
/ p™ "(1 — p)®"dp > wp B(a, B). 
JRp 


The problem corresponds to the case of defining a prior confidence interval [Ry,R,] with 
a probability u. Solving the problem, we again meet the necessity of using numerical 
methods. In the case of the quadratic loss function L(j, p) = (p — p)*, as shown in § 6.1, 
the minimax of the function of the posterior risk is reduced to the maximum of a prior 
variance U(a, 8) of the parameter p. In the final form, the problem (6.65) is reduced to the 
problem of Nonlinear Programming: 


wee Ch 
UG, pe = A ~ MN (a+ptny(a+ptn+l)’ 
a0 (6.66) 


ser p-1 
[> (1—p)P-'ap > wB(a, B). 


This problem doesn’t have an analytical solution, and requires applying one of the methods 
of Numerical Optimization. We will assume that R, = 1 and B, = 1. This case is associated 
with the practical situation when the reliability of a tested device is large, and a priori 


information has been obtained in the form of the “-confidence Bayes interval with the help 
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Table 6.11 


0.9641 
(0).0346 
0.9178 
0.9696 
0.0295 
0.9303 


of tests without failures. The problem is simplified, and takes on the form 
(a+n—d)(d+1) 


(O(?. O) = 5. 
( ) 50 (@+n+1)2(a4+n+2) 
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A posteriori TTF for exponential distribution. 


p=0.95 


0.9803 
0.0192 
0.9549 


0.984] 
0.0176 
0.9589 


a>0 


0.9957 
0.0042 
0.9902 
0.9958 
0.0041 
0.9906 


0).9959 
0.004 1 
0.9906 


0.9709 
(),0282 
().9334 
(),9746 
() 0247 
0.9418 
(),.9775 


Ry 095 


0.0153 


0.9856 
0.0)42 


0) 94649 


0) 9XAS 


0.9964 
0.0035 
0.9918 


().0220 0.0132 
0.9484 ) 9691 
1) 9798 0 9874 
0.0198 0.0124 


0.9536 
0.9874 
0.0124 
0.9711 


0.9711 
0.9909 
0.009} 
0.9790 


0.99671 
0.00334 
0.99242 


0.99676 
0.00326 
0.99255 


0.99680 
0.00316 
0.99267 
0.99696 
0.00314 
0.99279 


0.00287 
0.9934} 


R° <1—u. 


It is easy to see that the solution to the problem les on the boundary of the domain of 


admissible solutions, i.e., 


_ In(l =p) 


— 


Ink, 


(6.67) 


Now, for the estimate of TTF we should only apply the formulas (6.30) and (6.32) which 


take on the form 


r+ Ax a. +n—d 
— 5° — : 
G& +n+1 
a (a, +n—d)(d+1) 
(a, ene, Hn +2) 
and 
d+] 
Ree | = ———_—. 
= arn oa 


Fy Yilta's ly2a. end) 


(6.68) 


(6.69) 


(6.70) 


It should be noted that in the calculation algorithm for obtaining TTF estimates, based on 


the formulas (6.68)—(6.70). the parameter a, plays the role of the number of successful tests 
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Table 6.12 Bayes lower confidence bound of TTF for binomial testing. 


| oso | oss | 097 


Ry 


0.9413 0.9498 0.9536 0.9622 
0.9626 | 0.9696 
0.9907 0.9937 0.9952 


which are equivalent to using a priori information. Table 6.11 illustrates the dependence of 


the estimate Rp 4 on Ry and a prior confidence probability . 


Chapter 7 


Empirical Bayes Estimates of Reliability 


7.1 Setting of the problem and the state of the theory of empirical Bayes 
estimation 


In many problems frequently encountered in practice, a scientific designer possesses infor- 
mation on the reliability of technical devices appearing to be prototypes or analogs of the 
contemplated system. These analogs may be put into operation during a long period of time 
so that the information about characteristics of their reliability is certain. As prototypes 
with respect to contemplating technical device, the devices having analogous functional 
assignment and structure but differing from the original device by some new elements or 
parameters may be used (in this case, the device of interest appears to be a modification of 
a previous one); devices of the same type but made with the help of another technology or 
produced by another firm: the device which is being operated under the conditions slightly 


different from those applied to the original device. 


The following approach is preferable and perspective for elaboration of technical devices. 
Designer organizations contemplating model units accumulate statistical information about 
object properties represented in the form of testing results and exploitation characteristics 
of each model device. To design a new variant of the analogous technical device, engi- 
neers apply all their past experience in the field. This information is reflected reasonably 
in the methods of estimating the reliability, based on all preceding information about relia- 
bility characteristics of devices which already have been put into operation. This situation 
compels us to develop a method of reliability estimating under the conditions of data ac- 
cumulation. This corresponds to the tendency of a modern technology development in the 
conditions of an automatized project and production systems that use various databases. 
One method of estimating the reliability under the conditions of data accumulation can 


be based on empirical Bayes approach which uses a priori information, for example, in 
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the form of reliability estimates of all preceding types of the device, and doesn’t require 


determination of a prior distribution in a unique way. 


In this Chapter we carry out a brief analysis of all existing estimation methods within 
the framework of the empirical Bayes approach, and present practical recommendations 
touching upon the calculations of TTF estimates frequently used in practical situations. We 
propose also a new method of obtaining empirical Bayes estimates under the conditions of 


data accumulation. 


For the sake of simplicity of exposition of the foundations of the theory of empincal Bayes 
estimates, we consider the case of obtaining the Bayes estimate for the scalar, parameter 
6 and the connected reliability function, R(@). Using an empirical Bayes approach. we 
have to postulate the existence of a prior distribution of the parameter @ which is assumed 
to be unknown. The main idea of such approach lies in the use of a general scheme of 
Bayes estimation (see Chapter 2) of the approximation of either a Bayes decision rule or 
a prior distribution. Approximation in both of these cases is the basis tor the previous 
observations. The Bayes empirical approach was initiated by Robbins [211] and developed 
in the works of many. Authors (we shall only mention three such works in this field: [168. 
194, and 229]). 


7.1.1 Setting of the problem of empirical Bayes estimates 


Let 7!) = (ini tril) be the testing results (represented, for example. in the form of 
total operating times) which have been fixed in the j-th series of tests. Systems which 
have been tested in the I-st, 2-nd.....(M — })-th series are analogs to the device examined 
in the N-th series. Following a formalized description of the empirical Bayes approach 
[16, 208], we will assume that there exists a stable statistical mechanism leading to a prior 
distribution of A(@), unknown in general. The problem is to tind a Bayes estimate of the 
parameter @ of reliability function R(@) with the help of the results obtained in the N- 
th series, taking into consideration the testing results of the previous series. Following 
the earlier menuioned method of estimate representation, we will consider the following 
estimates: For the parameter @ consider the pointwise estimate 6°. the posterior mean 
value 6%,, the Bayes confidence interval (0, 6]y; 

For a TTF consider the pointwise estimateR®, the posterior mean value Op, and the lower 


confidence limit R} . 
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7.1.2 Classification of methods 


In Figure 7.1 we present an integrated classification of empirical Bayes methods. In the 
first place, all methods are divided into two kinds: parametric ones which touch upon the 
case with unknown parametric family of a probability distribution F(t; @) of the trouble- 
free time ¢, and nonparametric methods which are based on the assumption that F(t; 0) 


belongs to some nonparametric class § which is more or less broad. 


Empirical Bayesian 
Methods 


Non-parametric Parametric 


methods methods 


Exact methods for Use of Bayesian 


Iss decision rule 
distribution classes 


approximation 


Use of parametric Use of aprion 


approximations on distribution 


distribution classes approximation 


Fig. 7.1 Classification of Bayes empirical methods. 


In the group of parametric methods we distinguish two classes. The methods belonging to 


the first class use an empirical approximation of the Bayes decision rule without approxi- 
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mation of a prior distribution. The methods belonging to the second class are nearer to the 
general scheme of Bayes estimates. They are based on empirical approximation of a prior 
distribution and successive use of the standard Bayes procedure. These methods form the 
base for practical procedures of empirical Bayes estimates. 

In the group of nonparametric methods we also distinguish two classes. The first one. 
named by the class of exact methods, uses tools analogous to Ferguson constructions. con- 


sidered in Chapter 4. We shall revisit these methods in the third section of Chapter 7. 


7.1.3. Parametric methods based on approximation of the Bayes decision rule 


These methods are developed for the special well-defined parametric families. We present 
the following result, typical for this group of methods, obtained in the works [168. 170]. 
Consider a parametric family with a cumulative distribution function of the probability 


mass P(x | @), 6 € @ satisfying the following properties: 


1) A random variable X is discrete for any 6 € @; 
2) A function P(x | @) satisfies the relation 
Poe 1.0) 
P(x| @) 


where a(x) and b(x) are some functions, and where (x) = 0. Poisson and negative bi- 


= a(x)+b(x)@. 


nomial distributions may be considered as examples of such distributions. The problem 
is to find the estimate of the parameter @ in the form of a mean value 6, | E+ @ | x) with 


the help of the sample x;, x2,..., xy of observations of the random variable X. 


From the definition of parametric family P(x | 8), it follows that 
_ P(Xxt+1|8) ala) 
DXIPQ TO) bay 


The desired posterior mean value of the parameter @ can be represented in the form 


(x+ : a(x) 
E ACF | x)- : 
e ~ bi b(x) She a h(x) 
where H(@) and H(@ |x) ~ P(x | @)H(@ — are, respectively, the prior and posterior 


distribution functions of the parameter 6. The parametric family is of a type that the ex- 
pression for E(@ | x)may be simplified as 

P(x+1) a(x) 

Peaibty) OR) 


In this expression a(x) and b(x) are unknown, while P(x) and P(x + 1) are known. For 


BGA): = 


obtaining the estimate 6y = Ey(@ | x), we will use the corresponding estimates of the 
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functions Py (x) and Py(x+ 1) obtained with the help of the observed sample x1, x2,...,XN, 
where for estimates Py(x), Py(x+ 1) may be used usually as nonparametric estimates. The 


given method has a shortcoming, the strict restriction on the type of parametric family 
Pla: 


7.1.4 Parametric methods, based on approximation of a prior distribution 


In this class, representing the largest group of methods, one may distinguish two subclasses: 
The first one uses a parametric empirical approximation of a prior distribution, the second 
class is based, following the same purposes, on some parametric family of prior distribu- 
tions and estimated parameters of this family. Presentation of the methods belonging to 
the first class will be carried out in accordance with the results of the works [17, 48, 162, 
229]. The methods considered don’t have, unlike the proceeding case, any restrictions on 
the parametric family F(t; @). 

As a Starting point, the traditional Bayes formula for estimating the parameter @ with re- 


spect to arbitrary sample T is chosen, that is, 
_ | of | eaH6) 
[fete @aH(8) 


where f;(T | i is the density of the distribution of observations. It is assumed that each 


E(@'|\t) (7.1) 


observation t'/) (j = 1, 2,...,N) is a vector of the same dimension n; Note that this is a 
simplification of the more general case when each vector t\/) has a dimension n; 7 Unere is 
a statistic @ = 6(r) which is sufficient for each realization of the parameter @ from the set 


0),...,@y. In this case, in accordance with the factorization theorem [208], 
E(@|t) =E(@ | 6(t)) = E(0| 6). 

Then expression (7.1) may be rewritten as 

ie 6f(6 | 0)dH(0) 

[£61 @)4H(0) 


where, it is assumed that the distribution density of the statistic f(6 | 8) is known. The 


E(@|6)= (7.2) 


method proposed in [16] lies in approximating a prior distribution function with the help of 
step-functions having the increment 1/N in each of the estimates 6 ...., Ov. The indicated 


approximation for dH(@) has the form 


N 
Y 5(6:9), (7.3) 
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where 


Substituting (7.3) into (7.2) yields the resulting expression for the estimate of the parameter 


6 over the sample 7‘): 
§* = 5,0 (6) = = (7.4) 


The estimate 6* obtained with the help of (7.4) is called the first approximation estimate 
in [16]. It can be defined more exactly if one uses the following simple idea. Instead of each 
estimate 6; in the formula (7.4), we will use an empirical Bayes estimate 6 — 6° of the 
first approximation obtained from the formula (7.4) over the set of data T EN scree 9), 
Thereby we have the following procedure for obtaining the empirical Bayes estimate 6° of 
the second approximation. At first for each j = 1, 2,.... N we find the first-approximation 


estimate: 


a = Ny, (7.5) 


(esa es, (7.6) 


As stated in the work [162], the second approximation estimate appears to be more exact. 
In [16], Bennett proposes to use for obtaining a more exact value of the estimate the third. 
fourth, etc., approximations. However, the exact measure of the estimate is not improved 
as much as desired. Procedures for obtaining empirical Bayes estimates for different para- 
metric families are the subject of consideration in the work by Lemon [137]. These works 
give great attention to the questions of empirical Bayes estimates of the parametric Weibull 
family see [16, 17, 48, 107, and 163]. The discrete character of approximation of a prior 
distribution is a serious shortcoming of the proposed method. This obstacle doesn’t allow 
us, in particular, to construct confidence intervals for the parameter @ and the reliability 


functions connected with it. To this end, we apply the proposition given by Bennett and 
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Martz [18], which consists of using a continuous nonparametric approximation introduced 
by Parzen [191] for approximating a prior probability density 4(@) having the following 
form 


* Ny oo, 
h(8) = hy (8) Sa "(5 am): (7.7) 


where w(-)is a function, satisfying the conditions of boundness and regularity, and k(N) is 


independent of 8, such that 
jim k(N) =0 and jim NK(N) = &. 
Bennett and Martz use, in particular, approximation (7.7) for which 


: 2 
a0. 
w= (=) y= 28) and KM) = NH", 


2k(N) 
For this case, the Bayes parametric estimate of the parameter 6 takes on the following form: 
i nae 
0 = 5 [ar(| dy)h(a)a0, (78) 


where B is a normalizing constant. Now we can find the Bayes lower confidence limit of 


TTF from the equation 
J, £01 bxyi(oya0 = 7 f F(0 | vyh(a)a9. (7.9) 
R(8)>Ry @ 


The subclass of parametric methods used for approximation of a prior distribution of some 
parametric families gives us the methods, constructed in accordance with the following 
natural scheme [229]. For a given parametric family F(t; @), a likelihood function is con- 
structed and a prior distribution is identified, conjugated with the likelihood kernel. The 
parameters of a prior distribution are assumed to be unknown, and are estimated using the 
estimates 6 : 65 — Oy. In the work [212], Robbins shows that with the growth of N an em- 
pirical Bayes estimate begins to “forget” the type of prior distribution. This procedure may 
be improved with the help of the specific properties associated with the estimating scheme. 
The work by Higgins and Tsokos [107] gives us an example of such a modification. They 
prove the following: if one carries out the estimation of a prior gamma-distribution in a 
Poisson scheme using the variation coefficient, it is possible to increase the effectiveness 


of the Bayes TTF estimate. 


7.1.5 Nonparametric empirical Bayes methods 


Most of the known results arise from the Ferguson theory that we explained in §4.1. The 


first extension of this theory to the case of empirical Bayes estimates was done by Korwar 
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and Hollander [128]. In the work [245], Susarla and Van Ryzin generalize these results to 
the case of censored samples. Phadia [194] considers the particular case which is important 
for practice. Here all censoring moments are distributed by the same probability law. All 
obtained results are based on approximation of a prior measure @ with the help of the pre- 
ceding censored test outcomes (6). 7). (62. T2)...-. (One. Te vg). Mlwere tT, —min{Gp G,}. 
&; are failure times, ¢; are censoring times, 6, = 1, if the failure is observed and 6, = 0. 
if the failure has been censored. The estimate of the TTF, R(t). is constructed by the re- 
sults of the N-th observation (dy. ty) with regard to the mentioned approximation of the 
measure & of a prior Dirichlet process. Let us find the estimate R* it) obtained in the work 
[194] for the case when all censoring times have the same distribution while failure times 
have different ones. Assuming that the parameter of significance of the a priori information 
B = a((0,0)) is known, 


F &([152)) 
R*(t) = =—{ I [t < tw] + &([t32)) + 1[dy = 0, t > ty] }=————.. 
(= Mlle < o4] + Gl lr:%)) + By Ig 
where 
; RG Nee 
(04 [co = a 
ey LIN rere ) 
N‘(r)is the number of observations from the set tT). T..... Ty 1. exceeding r: / A the 


indicator of the event A: if the event A has occurred / = 1, otherwise / = 0. c is a positive 
constant, controlling the smoothness of the estimate (in practical calculations one often 
putsial—all): 

It should be noted that all considered methods have the following shortcoming: they don't 


allow us to estimate the exact identification of R*(r) and to find its interval estimate. 


7.2 Empirical Bayes estimation of the survival probability for the most ex- 
tended parametric distributions 


In this section we shall consider the more general procedure of parametric Bayes TTF 
estimates and its particular realizations for the cases of binomial, exponential and Weibull 


probability distributions, as well as for the case of a linearly increasing failure rate function. 


7.2.1 General procedure for obtaining estimates 


Suppose that the random time to failure obeys the distribution with c.d.f. F(t; 6), and we are 
given the information of the results of N tests T! aaa ge having sizes 1). 2....,AN. 


respectively. Each vector t'/! represents the union of two vectors: 1°") the failure times, 
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tJ) the censoring times having sizes d; and k;, respectively, such that nj = dj+k;. We 
need to find an empirical Bayes estimate of the TTF, R(t; @) = 1 — F(t; @), for the sample 
7) using the results of the preceding tests. 

The presence of a parametric family allows us to write with the help of expression (3.20) 
or (3.21) the likelihood function ¢(@ | t) for an arbitrary sample t, and having generated 
the sufficient statistic a, in the form (0 | tT) = K(t)0(0; a). 

The desired TTF estimate of R(@) may be found if for results of the N-th series of tests a 


prior density of the parameter @ is known. In view of Bayes theorem we get 
n(o | o)) =n(@ | a) ~ h(@)eo(0; a). (7.10) 


A prior density 4(@) is unknown, and we will approximate it. To this end, we assume that 


(2)... 6°), each of which has been obtained with the help of its 


there are estimates 6!), 6 
“own” sample t'/) (j = 1, 2,...,N). For obtaining the estimate 6) we may use any statis- 
tical method suitable for these purposes, it is desirable certainly that the obtained estimate 
is as effective as possible. In particular, we may use a maximum likelihood method, then 
components of the estimate 6'/) should be found by solving the set of equations 
ae(0; a!) 
06; 


where m is the dimension of the vector 6. For the same purposes we also may use the 


=0=> 6) =6, i=1,2,...,m, (7.11) 


methods which determine the estimate ew ) as the posterior mean value for the sample qi): 
alti 1 
6) = ca 0,fo(0:a))h;(0)d0, i=1,2,...,m, (7.12) 
; JO 


where f; is a normalizing factor, and h;(@) is a prior probability density of the parameter 
8 which possibly exists when we investigate the reliability for the j-th series. If there is no 
a priori information in the j-th series, one should use as h ;(@) the uninformative Jeffrey’s 
density [114]. 

For approximation of h(@) we will use in the relation (7.10) a nonparametric discrete esti- 


mate of the density for which 
5 ee A, 
=- ¥ n,5(6"),6), 7.13 
dHi(6) aoe (6), 6) (7.13) 


where 
lif x=. N 
5(x,y) = : 4 and > 
Ont <3; j=l 
The obtained estimate generalizes the estimate (7.3), used in the work [16], for the case 


of the samples t\) having different sizes. The corresponding estimate of the empirical 
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function of a prior distribution H(@) has the form of the step-function with the increment 
n;/n at each point 6"), 

Now, suppose that we nced to find the estimate R = R*(ty) in the form of the posterior 
mean value (if we use a quadratic loss function). This estimate, based on approximation of 


a prior distribution, is defined by the integral 
J Rlt0:0)fo(@:a) 446) 
ae: eee 


(7.14) 
/ lo (0; a") )dH(@) 
oO 


? 


where a) is a sufficient statistic, corresponding to the sample t ‘ . Let us substitute 


approximation (7.13) into (7.14) and simplify the obtained formula. This yields: 


N q : 
yY njR(to: 8" \iha( OT nae 

R* (to) = FO ee, (7.15) 

Y njlo(' a ) 

jm | 


J 
The empirical estimate of the posterior variance can be found analogously without any 


difficulties: 


=] ay 

Oe i =¢ N — —f, (Io). (7.16) 
Y njlo (OM); af%)) 
j=l 


Note that we don’t meet such a form of a parametric empirical Bayes procedure in all of 
the works cited above. We believe that the empirical Bayes procedure given above appears 
to be the most general among all the procedures that use a discrete approximation of a prior 
distribution. Unfortunately we cannot find interval estimate Ry of TTF with the help of this 
procedure. For this purpose we recommend using some approximate methods. based on 
the knowledge of the pointwise estimate Rs (1) and mean-squared value C5. , 

In conclusion, we note that the general procedure given above lets us find empirical Bayes 
estimates of the second and successive approximations. To do this. we need to first find 


empirical Bayes estimates of the parameters 6!) of the first approximation 
pp 


i a A 
y 16 (O's! uy 
i ; a a Gi 
¥ glo (6: otf) 
kel 
and thereafter replace in (7.15) and (7.16) the estimates 6") by the first approximation 


estimates. 
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7.2.2 Binomial scheme 


First we consider the simplest binomial case, when the data tl) (=e... N)representiby 
themselves the set of 0 and 1, and the sufficient statistic a'/) = (nj,d;) contains the total 
number of tests n; and number of failures d;. A TTF, in the given case, coincides with the 


value of a single parameter p, and the likelihood function has the form 


e(p;n,d) = (") po ep). 


In accordance with the common expressions (7.15) and (7.16), the empirical Bayes estimate 


may be written as 


2 njpj "(1 — pj)in 
a ll 
Re = ——______, (7.18) 
AIN—dy ~ \d 
L ni; (hp5)e% 
= 
and 
N A N-d am 
L nie; a 
= (7.19) 
G N AlN an a \d 
XP; Spa’ 
Jr 


Instead of j; we may use the maximum likelihood estimates p; = 1 — d;/n;. However, in 
the case d; = 0 we have p; = 1 which makes the estimate (7.18) inaccurate. It is advisable 


to use the Bayes estimate Bj obtained for the uniform prior distribution. In this case, 


Jj 2 d; 
— LCV arity 
a —————— 


J 1)! dj 
Xi- ) Wanita, Fre) 


and for d; = 0 we have Pj = 1—1/(nj;+2) which mostly corresponds to the real situation. 


7.2.3. Exponential distribution 


For the parametric family 
F(t;A) =1—exp(—At), 
the likelihood function of the sample t\/) has the form 


0(A | t))) ~ bo(Asd;,Kj) =A%e AN, 
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where K; = an + oe ae ah and d; is the number of failures in the j-th sample. Due 


to this fact, the empirical Bayes estimate of the failure rate A is computed by the formulas 
Sa (7.20) 
and 


Cee (7.21) 


The problem is in what way should we construct the estimate i, with the help of the sam- 
ple t'/). For many empirical Bayes procedures one proposes to use maximum likelihood 
estimates. Solving the likelihood equation inconformity for the given case. we obtain the 
estimate of the form A; = j/k}. 

For highly reliable devices it is possible to meet a situation when there are no failures 
during the testing. This automatically gives us zero estimate ie If one fixes in all \ series 
only successful outcomes (all samples t'/) consist of only stopping times without failure). 
then the formulas (7.20) and(7.21) don’t hold. It is more advisable to choose as i. the 
Bayes estimate constructed with the help of the sample t'’ which corresponds to the case 
of trivial prior information. Such an estimate may be found if we put a uniform prior 
distribution for A in the interval (0. c2). In this case the estimate A = Rd 110%, “atta 


formulas (7.20) and (7.21) hold for any outcomes in each of the N series of test. 


7.2.4 Distribution with a linearly-increasing failure rate 


The Bayes TTF estimate for this case was obtained in $3.4. Let us apply the results of this 


section. In accordance with (3.54), the kernel of the likelihood function for the sample t / 


has the form 
lo(a2.wj,K;) = aj(z)r7F™ | Inr|%, (7.22) 
where 
| dj 6” 
az) = z—-1)+—+1], 
j(2) Gane il ( ) ii 
| 
bj(2) = Fl(e— 1K; +20], (7.23) 
1e (i) 14 cy 
Oe _ and Sa ‘i 
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to is the time during which we define the device TTF. 
Consider first the case when the degradation parameter z is assumed to be given. We will 
find empirical Bayes TTF estimates using the likelihood kernel pPil=)| Inr|4i. The resulting 


expressions for these estimates have the form 


7 njR NO In Bi |@n 
Pe ! 
Rt = re (7.24) 
ze R? [mR lew 


and 


N ADaTE e 

yak | Inkl 

j=] a” 

Of, = eT al; —R?, (7.25) 
ye nk MO) In R [an 

j=! 

where 


by(z) = 


ye pee 
Ga +a il 
0 j=1 19 j=] 


For R; we recommend using the Bayes TTF estimates with a linearly increasing failure rate 
for the uniform prior distribution in [0,1]. In view of this and with the help of the function 
I(2.R,.R,.md) We obtain 
g = Met [1 - 1 ee aan 
1 11(z,0,1,0,d)) bj(z)+1 
where b; is computed by the formula (7.23). 
Consider the more common case when the value of the failure rate degradation coefficient 
z in the interval [0,fo] is unknown. We will assume that only the limit value z,, is known 
such that the degradation coefficient is always less than this value. To obtain the empirical 


Bayes estimate we have to use the likelihood kernel (7.22). The resulting expressions have 


the form 
N ain (41 
L man (A, [in R | 
K3() = = ee (7.27) 
N ane ~ 
L njan(Zj)R; ” |InRj|4s 
i 
and 
N ne : 
¥ njay(2;)R,”” ‘ [inkl 
= ' 
ey), (7.28) 
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We again recommend using as estimates R, and 2, (j = 1.2..... N). the Bayes estimates 
corresponding to the case of trivial a priori information, that is, the indices R, and z, obey 
a uniform prior distribution in the intervals [0.1] and [1.2m]. respectively. Using the results 
of § 3.4, we can write the formulas for obtaining these estimates: 
Rag [ee (7.29) 
Bj A [bj{z) + 2)% 


and 


een mo <analde 

is om, Hee 
where 

_ fo __4ilz)dz 
B= Lari 

Estimates (7.29) have at least two advantages in comparison to corresponding maximum 
likelihood estimates. To obtain the last ones we have to solve a complicated system of tran- 
scendental equations for the general case. Otherwise. if we use the formulas in (7.29). we 
need only to apply the methods of numerical integration for sufficiently smooth functions. 
Moreover, the maximum likelihood estimates for highly reliable devices give us ford, — 0. 


R; = 1, 2; = 1, i.e., formulas (7.27) and (7.28) don’t work in this case. 


7.2.5 The Weibull distribution 


The present model is almost identical to the previous one. We apply the results of &3.5 
for the description of this method. For the Weibull parametric family with the cumulative 
distribution function F(t,A,@) — 1 exp(—Ar™), we introduce a new parameterization 
(r,@), represented by the relation (3.66). Then the likelihood function is written in the 
form (3.67). Leaving the intermediate calculations, we write only the resulting formula for 
TTF estimates, R(fo). 

For the case when the form of the parameter a is known, we have 


N aA na 

y ng ' | Ink |4" 

A * I= : 

he (to) = aT, geet oe (7.30) 
¥ ajR | In Rj\4n 

Fd 


a pox inR|4N 
ae j |InR;|* 


J 


= ——__,______—. — R*? (19), (7.31) 
LY nih nile 
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and 
1 7441 aj fol) 
R= [1-5] , oa) = 3 (5) 
Now, we shall consider the case when the form of the parameter a is unknown. We will 
assume that the maximal value 0, > @ is given and q is distributed uniformly in the 
interval [1,Q,]. For almost all practical situations a@ < 5, therefore we may certainly put 
Om = 5. The resulting estimate of the TTF is given by: 


N 5 ee 
andy ,, 6-1 p2M(G;)+1 A 
L njoj; Uy R; | In ;|4” 


Ri() = = . (7.32) 
Lu andy ,,Gj—1 5 °N(&;) A 
Ln i Uy OK; | InR,|4n 
j=1 
and 
N Fy Once. 
x nj wR? in Re 
2 _ dE" 5x2 
CRN ee (to), (7.33) 
ys nj Qi" My’ 'R,; Vin R j|4v 
j=l 
where 


Bj Ji Ya (x) + 1%"! 

Ny eis dx 
rs eats sith x-1 
J B; , eg] co; (x)4i+! 

d 
Qn dx fl res) 
; x1 

Sg eo; (x)\tit!’ : oa Na 


7.3. Nonparametric empirical Bayes estimates of reliability under the condition 
of data accumulation 


7.3.1 Description of the problem 


Development of in-house databases is one of the most important aspects of an industrial 
complex. This cumulative information is analyzed, systematized and prepared in a de- 
sirable format to be easily accessible to the users. One extremely important use of this 
information is to develop reliability models to measure the quality of product-oriented in- 


dustries, see Belyaev [15]. 
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Belyaev obtains a new type of multiple estimates of a TTF under the conditions of accu- 
mulation of uniform data, i.e., under the assumption that experimental data of each new 
portion obey the same distribution law. 

Below we attempt to estimate a TTF with the help of nonuniform data. denoted by 
D,, D2,...,Dy. The solution of the problem is based on the empirical Bayes approach 


(see scheme in Fig. 7.2). 


Data Bank Testing 


Dip 2) Naa results of Dy 


Empirical Bayes 


procedure 


‘PE 


estimate 


Fig. 7.2 Solution scheme. 


Suppose that we have a problem of estimating the device TTF using the experimental re- 
sults of its testing, Dgey. The designer operates with adatabase which contains the failure 
results of the device that is being tested. Using the empirical Bayes approach. we will 
find the TTF estimate by the experimental results, Dge,. taking into consideration a priori 
information stored in this database. In accordance with the number of given database ob- 
servations, we will denote them by Dy — Dye: the observations storedin the database will 
be enumerated in accordance with the sequence of their appearance, D). D>... Dy |. The 
problem is to find the estimate of TTE, R* = R*(D, DN ac Dy 1). Consider a possible 
form of representation of the observations. In [15] one proposes to represent the data D, 


for the censored samples of the testing durations in the following form: 


j j) j) 

a) sf) gl! 

— GV) Ald) (/) 
Dj = dy dy vt dn; 
Ku) Ki me Ky) 


The first row contains the testing durations, fixed in the experimental operating time, and 


(J) 


written in increasing order; s 4 may be either the mean lifetime or operating time during 
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which the system has the capacity to be operable, and thereafter the testing has been termi- 
nated. In the second row j-th column represents the number of failures corresponding to 
(/) 


the operating time s;"’. In the i-th column of the third row, we have the number of devices 


which have been tested at the time sv ) before the failure occurs. Later on such a generalized 
representation form of the censored sample will be used for investigations. 

In addition to this method of representation of information about reliability, another ap- 
proach may be used, corresponding to the case when the database contains directly the reli- 
ability estimates. Denote by C; the j-th observations of the data. The contents of C; are two 
numbers: either the pointwise TTF estimate of j-th analog R; and the error of its estimate 
Op, or the union of R; and lower confidence limit Rj. Let us assume that C; = (Rj, OR, ). 
The scheme of obtaining the estimate Re for this case will be slightly changed (see Fig. 7.3). 
It is clear that the passing Dy — Cy is connected with the loss of information. 

The problem of obtaining a TTF estimate will be solved under the assumption that the 
distribution function of the time to failure, F(t), belongs to the class of failure rate distri- 
butions So. The idea of obtaining the estimate lies in the construction of a suitable change 


of the function F(t) with the help of the distribution function F(t) € So. 


Data Bank 
Cin a= Cu | 


Empirical Bayes Testing 


procedure results of Cy 


1Ue 


estimate 


Fig. 7.3. Improved solution scheme. 


7.3.2 Solution of the problem for form D data representation 


We will use the following approximation of the unknown distribution function F(r) with 


the help of a two parametric piecewise linear approximation of the resource function A(t) = 
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—In{1 — F(r)], that is, 
A(t) = 2 (to —tat + 4(t —to)[@t — (@ — a)to] (7.34) 


where fo is the time for which we determine the TTF estimate, and 6 and @ are parameters. 
The form of approximation A(t; @,@) is shown in Fig. 5.1. The parameters @ and @ are 


defined by the following conditions: 


1) At the point fo, for which the TTF estimate is evaluated, the function F(t) and F(t) = 
1 ~ exp[—A(r)] coincide: 
2) The approximate distribution function, F(t) = || = exp!—A(r)’. belongs to the class of 


failure rate distributions. 


Similarly, as in § 5.1 we consider the following conditions on the parameters @ and 6: 


a= me InR, (7.35) 
to 


where R = 1 — F (tg) is the unknown value of TTF and 
2a. (7.36) 
Using the equation (7.36) above we can write the likelihood function 4(@.@ D,1 as: 
€(at, @ | Dj) = K(Dj)a" 64) OKI) (7.37) 
With the help of expression (7.36) the likelihood function ((@.@ | D,) may be written as 
eat, @ | Dj) = K(Dj)a" 6%) 0X7) (7.38) 


The sufficient statistics included in (7.37) can be interpreted as follows: r, is the number of 
failures in the data set D;, observed before the time fo, uw, ts the number of tailures after the 
time fo, K; is the total operating me during the test until the time fo, uw, 1s the same as K, 
after to, K(D;) is a statistic independent of the parameters @ and 6. The calculation of the 


indicated statistics is carried out with the help of the data set D, by the following formulas: 


ee. By : 
rad?) aa ee? (7.39) 
i=l i=mj+1 
ny ere ny ; 
KEM +L 4m Ya +H, 00 
f= i=m;+1 
and 
nj ; 
m= Yd +e?) (s/ - 10), (7.41) 


tem, +1 
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where m,; is the number of elements in the sample ss), ast) satisfying the conditions 


: i Reedy oe} 
s\”) <9 to, defined by the formula 


nj ; 
mj= Yi x(to—s)”) 
i=l 
Now, having obtained the completely defined likelihood kernel (7.37), we may find the 
empirical Bayes estimate of a TTF following the general approach given in the preceding 


section. The function, R = R(to), will be expressed with the help of A(t, a, 0); by substi- 
tuting the value t = fg into (7.34) we get 


R = R(to) = exp[—A(to: a, 8)] =e". (7.42) 


With the help of (7.15) and (7.16) the formula for TTF estimates takes on the form 


ay nj aN are —[4j(Ky+10)+8 jun] (7.43) 
and 
op. = ay 2 nja” 6 e —[05j(Ky-+40)+ Bun] _ 2, (7.44) 
= 
where 
B= 3 THe es oe (&jKn + 8jun), (7.45) 


jel 
For application of the expressions (7.42)-(7.44), it is necessary to know the estimate 
(G;,6)) obtained with the help of the data D;. In the preceding section, it was men- 
tioned that the likelihood estimate cannot be used for this purpose. Under these circum- 
stances we recommend using the Bayes estimate corresponding to the noninformative prior 
probability distribution. Let us use this recommendation to obtain the estimates (;, 6;), 
j =1,2,...,N. To find the noninformative prior probability distribution for the parameters 
a, and @, we assume that R = exp(—fo) is uniformly distributed in the interval [0,1]. With 
the help of the transformation (7.35), we can write the marginal prior density, hj (a), of the 


parameter @ as follows: 
h\(a) = toe, O<a<oo, (7.46) 


This expression is a particular case of (5.30) with R; = 0 and R, = 1. We now define the 
conditional prior density, h2(@ | &), taking into account the inequality (7.36), and assuming 


that, 42 (@ | a), as well as h; (a) belongs to the class of exponential probability distributions: 


ho(@ | a) =toe (F-”, a <O0<~. 
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Now, we can easily write the joint prior density of the parameters @ and 6: 
h(a,0) =h(a)ho(0|a)=Ke , O<a<w, a<O<~. (7.47) 


Using expressions (7.37) and (7.46), we obtain the posterior probability distribution of the 


parameters @ and @ with data Dj: 


h(a.,@|D;) = Fo daca O0<a<a, ax<0<~, (7.48) 
i 
where 


B= | i; ai "i exp { —[@K; + (uj +t0)|}dOda. (7.49) 
0 J2 
Thus, the Bayes pointwise estimates 6 and & are given by 
a=} | ah(a,@|D,)d@da and ok / @hia.@ D)d@da. (7.50) 
JO Ja d J0 Ja 


Having derived the integrals (7.49) for the function f(@.@ D,) of the form(7.47) and 


integral (7.48), we can write the resulting formulas for the desired estimates: 


A (ujtrj+1—i)! 1 
a; = ee ee (7.51) 
* toBy = (ap)! (@); +1)! (@; + Ir 
6 TNS tri ta i! ee (7.52) 
di toB; 0 (eo re (a; + 1 '(@;+ Itt t 5 
and 
a (ujtrj—i)! l 
Bj = el iael (7.53) 


(uj)! (@yj + D(a NOTA 
Let us note in conclusion that in practice we may meet a case when a scientist. carrying out 
the statistical analysis of each series of tests which possesses nontrivial prior information, 
i.e., he can find an interval of an uncertain prior indeterminacy [R,,.R, | such that R, € 
[Ree | Jf = 1.2... N. Such a set of data should be completed by two numbers R,, and 
R,,;. (It is clear that in some cases Ry w@OoR,, wl. ie., there is no a priori information.) 


In this general case the expressions for the estimates &, and 6,” have the following form: 


ne 1 ee Cre ent 
Bi Ay (ujy—i)! (@ytlP 2 (aytrj+1—i-k) (@j+t™ 
x (R Rul '|InRy, ‘eau +1—i-k — RY! NG hac aa (7.54) 
6 wi tl'S bi ee Gea 
;= _ Ves 


to; pari) (uj : | ai)! (oa! ‘0 Cee oe. ae 


1 d, a oe = 
x (R a [In Ry, i fAihp tol Kee Rei inet a (7.55) 
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and 
soi) (Oj FI SG tk) (Oty 
X (Rae ink, eer Re hey Tt), (7.56) 


where @); and @; denote the dimensionless statistics and @; = Hj/to and @j = (Kj + 
U;)/to, which can be interpreted as the cumulative relative operable time in j-th series af- 
ter time fo, and total operable time, respectively. The expressions (7.50)-(7.52), obtained 
earlier, can be derived by (7.53)-(7.55) if one sets in the latter Ry j = Oand R,; = 1, respec- 
tively. 


7.3.3 Solution of the problem for the form of data representation 


Since the information contained in C; touches directly upon the reliabilityfunction, Rj, we 
need to develop the empirical Bayes procedure, using a random parameter the unknown 
value R;. We start with the following formula for a joint prior probability density h(a, @): 
h(a, 0) = hy(a)h2(O | @) =hy(a)tpe9-™", Oc a<wm, a<d<~, 

assuming that 4;(@) is unknown. Using the likelihood function of (7.37) and Bayes theo- 
rem we write the posterior probability density of these parameters: 

h( oz, @ | Dj) ~ 71 0% @ (AK +3) py (qe) @~ (9-0, (7.57) 
Thereafter, we take into account the fact that unknown TTF R = R(to) = exp(—@Qtfo), is 
defined only by the parameter a. Then from the expression for the joint probability density 
h(a, 6 | D;), we obtain the marginal posterior density 


n(a | D;) = | na, | D;)d0 


i ] gin 
& (uj; —i)! (uj +10) aa 
and then, we find the posterior prone density of unknown TTF, R, using the relation 


a(R) = —InR/to; 
hr(x | Dj) ss h(a(x) | D;)\a’ (x) )| ie [ax(x)]" e a) (Kj +H,) 


>) ae = een 1 (0e(x))|@r'(x)] (7.59) 
=O 


The expression enclosed in brackets in (7.59) is, by definition, the marginal prior probabil- 


~ ie UKitH)) h(a), 05 a <, (7.58) 


ity density, hg(x), of the reliability function R, which is unknown. After simplification, we 


have 
ell 1 (Inx]its-* 


he(x | Dj) ~ he(x)x® Yo 


fap (uj —8)! ‘(ayj+ Det (7.60) 
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The expression for the posterior probability density (7.59) of the N-th test series with the 


data set Dy enables us to write the desired pointwise TTF estimate in the form 


where 
1 | Inx| r+u-i 


foCaneNen 1) =29° 7 (ui)! ‘(ant 


(7.61) 


When we use the formula for R%, two questions remain open: what do we use as an esti- 
mate Ry and how should we substitute the unknown sample sizes n, participating in the 
procedure of obtaining the estimates R; Cia ae N — 1). To answer the first question 
we will apply, as before, the recommendations of § 7.2. Choose as Ry the Baves estimate 
of TTF, obtained with the help of the known data Dy. and use the posterior probability 
density (7.59). If we assume that the interval of an uncertain prior, R,y. Ruy . is given. 
then the estimates Ry and Og, May be found with the help of the formulas analogous to 
(5.73) and (5.74): 


I, (@y, On, rw + Uy, Uy) 


iN (7.62 
Sain Onin one) ) 
and 
i (@, @ WV, +u u ) PS) 
2 1( Oy, ON, TN + Un, UN, 
ohy = Toe ememen 7.63 
AN In(@y. Oyen + tty. tty ) N ( ) 
where 
k ; ye n-i 
(n—i) | 1 
In( @,@,n,k) = (oan eee 
mm 1,7, = hy 1)! (a, +1)! (i—=1—9)! 
|: ap A+i+ +m-+ 
Top payee (Rind In Raw — Rem" inRey|"7). (7.64) 


In a simpler case, when there is no a priori information in the form of the interval 
[Rev Run]; the function /,(@,@),n,k) has the form 
k ‘ 
2) | ] 

| PAC OO} @ Som eS eee le 

m(@, 7k) ree (@, + 1)! (@4+m4 1)! eo 
The calculation of the estimates Ry and OR, should be carried out, as before, with the 
formulas (7.61) and (7.62), but for this purpose we use the function (7.64). 
Consider now the second question touching upon the needed replacement of the sample 


sizes nj. Recall that these quantities have been introduced in the general Bayes empirical 
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procedure as weight coefficients reflecting the significance of each estimate under approx- 
imation of the posterior probability distribution. It is assumed that increasing the sample 
size used for the estimate implies a significant increase. Since the exactness of the obtained 
estimate appears to be, in some sense, an equivalence, we will use as characteristic of the 


significance of the j-th estimate the following quantity: 
1/6p, 
: a. J — 12... NN. (7.66) 
Such a choice may be explained, for example, by the fact that for most of the estimates 
=| 
The resulting expressions for the empirical Bayes TTF estimate have the following form: 
me v1 vjRjl0(Rjsrv, rv, Ov, Ow) 
ee a (7.67) 
D1 ¥jl0(Rys rv, un, Ov, On) 
and 
ga DNL vjpR3lo (Rj: rw, uv, On, Ow) pe (7.68) 
Ke YN vjl0 (Ris, un, Ov, Oy) a 
where f(x; 7r,u, @, @) ) is given by the formula (7.60), 


7.3.4 Comparative analysis of estimates 


It is clear that the estimate, found in accordance with the second scheme, is more general, 
since the data D; may be reduced to the data C; with the help of formulas (7.61) and (7.62) 
by letting V = /. Use of this transformation allows us to estimate TTF for the mixed scheme 
when the database contains both data’s D; and C;.The point is that the TTF estimate for 
some j-th device may not always be found with the help of D;; we may need another source 
of information. Thereby, the second scheme allows a joint processing of reliability data, 
obtained with the help of different schemes. We should note also another important aspect. 
If one constructs a procedure by the second scheme, then it is possible to use the continuous 
approximation of the prior probability density, ig(x), by using Parzen’s formula (7.7). This 
allows us, in turn, to find the lower confidence limit of TTF in accordance with equation 
(7.9). The construction of the scheme of defining the lower confidence limit of TTF is a 


further development of the proposed method. 


7.3.5 Investigation of the accuracy of TTF estimates 


Accuracy of the estimate Re obtained by the proposed method, will be studied using statis- 


tical simulations. Let us simulate 5 samples of sizes 20, 40, 60, 80 and 100 from a random 
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Table 7.1 Comparison of the Bayes estimate of TTF with a true value and non-homogeneous a prion data. 


Oy = 1; R(to) = 0.7516 


nye@20 ny ~ 60 ny 80 ny 100 
0.7139 0.7328 0.7509 0.7524 
0.7318 0.7240 0.7418 () 7449 


0.7443 0.7530 07818 
0.7415 0.7488 0.7887 
ty = 2: R(t) = 0.9216 
: 0.9230 
4 0.9235 
0.9224 
0.9244 
Oy = 3; R(t)) = 0.9769 
2 0.9779 0.9744 09773 
4 0.9735 0.9731 0.9261 


0.9722 0.9746 0.9760 0.9753 0.9762 
0.9754 0.979 0.9722 0.9733 OYzSs2 
variable with the Weibull distribution 


F(t) = F(t;o0,a@) = 1—exp |- (5)"| (7.69) 


where parameter @ = Qy is fixed. Censoring to the right is carmed out by the random 


0.9209 omni 
0.9187 0.9207 
0.9238 ).9230 
0.9244 (1.9238 


number having the uniform distribution in the interval [kj 0, k20}|. The observations are rep- 
resented in the format Dy. For obtaining data sets C, = (Rj. R, De — ES... le 
similar samples of 40 sizes for different values of the shape parameter @, are simulated. 
This parameter is chosen randomly in the interval [0.8ay, 1.2a@y]. 

Thus, we ensure the second scheme as the result of transformation of the first one for 
nonuniform data D,, D2,....Dy. The results of modeling with fo 100s, ox=3505. 
k; — 0.75, ky = 2.0 for different N are represented in Table 7.1. Comparison of the empir- 
ical pointwise Bayes estimate Rt with the exact value of TTF lets us draw the following 


conclusions: 


1) With the increasing of the sample size ny, the estimate R* approaches the exact value 
onlir: 
2) With the increasing of the past data, the distance of the estimate R* to the exact value 


decreases. 


In Table 7.2 we represent the results of modeling for the case when the data 


C\.C2....,Cy } are generated by simulating homogeneous samples, i.e., the parameter 
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Table 7.2 Comparison of Bayes estimate of TTF with the true value and homogeneous a priori data. 


On— ie R(to) = 0.7516 


ONP= 2: R(t) = 0.9216 


0.9241 0.9234 


0.9244 0.9212 


Table 7.3. Comparison of Bayes estimate R* without a priori information (N = 0) for Weilbull 
distributions with Q@y = 3 (R(to) = 0.9769). 


Homogeneous data 


0.9740 0.9753 0.9787 0.9755 
0.9751 0.9788 0.9753 0.9761 


0.9780 0.9772 


0.9787 0.9755 
0.9744 0.9773 


0.9731 


a during the simulation of the data D;, D2....,Dy is constant. Here we observe a prop- 
erty opposite to that one in the conclusion (2): with the increasing of N, the accuracy of 
estimating the exact value of the TTF increases. 

The specific features mentioned above are in full accordance with the qualitative informa- 
tion about the properties of empirical Bayes estimates. 

In reality, since the prior information is very influential under the small sample sizes, during 


the process of nonuniform data we encounter distortion of the posterior probability distri- 
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bution. At the same time, if the past data and Dy are homogeneous, the completion of the 
sample Dy occurs which implies an increase in the accuracy of the estimate. 

An illustration of this fact is that in the first and second cases a priori information allows 
us to increase the accuracy of the estimate obtained in comparison with the situation when 
TTF estimating is carried out only with the help of the sample Dy. 

The conclusions we have made confirm the workability of the proposed method of empiri- 
cal Bayes estimates and reinforce the quality of the estimate because of the use of the prior 
data. 

Theoretical analysis of the quality of empirical Bayes estimates in accordance with the 
properties of prior data is impeded by the complicated form of the procedure of construction 
of nonparametric estimates. During the process of extensive statistical experimentation, we 
find that using a prior nonhomogeneous data portions can lead to a bias in the empirical 
Bayes estimates. This bias increases with an increase in the testing size tor the tested device 


while the structure of the data about similar tests does not change. 


Chapter 8 


Theoretical Model for Engineering Reliability 


8.1 Setting of the problem 


In this and later chapters we shall investigate the methods of calculating the TTF of a 
technical device with the help of parametric models. The essence of this model is a for- 
malization of the conditions of a normal (without failures) functioning of the device by the 


functional inequalities of the form 


ZG) — OO Gt) a XING td) (Gat),0- 2 XNG.t) > 0, j= 1,2,...,M, 1) 


where Z;(€.1) is the initial random variable, depending on multivariate coordinate ¢ and 
time r; Z; is a status variable, @;(-) is an efficiency function. For the reliability function, R, 


in the general case we will use the probability expression given by 
RRC) =F4Z,(6,1) > 0, jee 2,...,.M, CER, 0O<1 <4}. (8.2) 


A lot of works are devoted to the application of such an approach for the investigation of 
technical devices (26, 32, 89, 112, 135, 173, 260]. The results of Chapters 8-10 repre- 
sent the development of traditional methods of estimating TTF for technical devices under 
the condition of uncertainty with respect to initial data and the survival state model. In 
this chapter we will use a particular form of the reliability function (8.2), considering the 
object state in a fixed moment of time to and for a fixed point of the device Co with the 
most dangerous functioning conditions. In real practical situations for mechanical devices, 
the vector of initial variables X = (X,,X2,...,X) generates physical-mechanical charac- 
teristics, geometrical parameters and loading factors. Usually we have certain information 
about these variables which lets us find a probability density, fy (x; @), at least with an ac- 
curacy up to the parameter vector 8. Most commonly used in practice in the normal model 
when the parameter vector 6 = (6), 02,..., O) consists of the expected values m;, standard 


deviations 0; and correlation coefficients pj; (i, 7 = 1,2,...,N, i<j). The point is that in 
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real situations the error of the working capacity model (8.1) and initial data in the form of 
parameters 0), 02,..., 0, may be so large that the gain in strictly defining the TTF through 
the use of more exact (different from Gaussian) probability distributions gives us no posi- 
tive effect. Thus, the authors choose another approach to improving existing methods. We 
shall proceed with the development of the error of the methods of estimating TTF. count- 
ing on all the possible initial data and the working capacity model and using the normal 
distribution for the approximation of the function fy (x: @). It is clear that the ideal way out 
of this situation is the solution of the problem of simultaneous consideration of all types of 
error that we mentioned. Unfortunately, such a problem takes on a very complicated and 
tedious form and, in most cases, is beyond the limits of engineering methods. 
In this chapter we shall consider a simpler problem of estimating the device TTF with 
the help of uncertainty in assigning the initial data under the assumption that a working 
capacity model is free of error. Later on, we will touch upon a more general problem 
counting on both types of errors. We consider the Bayes approach as a methodological 
basis of solving the problem, and assume that only the experimental results are the actual 
information for the acceptance of decisions. 
In accordance with the form of the working capacity model (8.1) and general expression 
(8.2), we rewrite the TTF in the form of the N-dimensional integral 

R=Rx(0)= ff f(xs@)dry dey (8.3) 


P(r.) >0 
j=l.2..aM 


There is another way of finding the reliability function, R, consisting of the folowing steps: 
we perform the transformation X — Z and find the probability density f7(2: 0) of the veetor 
of state parameters, Z, where 8 — (0B), th..... 0,) is a vector of parameters. and evaluate 
the M-dimensional integral 

R= Rz(8) = [ uf fz(z; 8 )dz, »+ Aig. (8.4) 
Since the transformation fy(x:@) > fy(z. 8) is univalent. the vector 3 is determined 
uniqucly by the vector @. If the parameter @ or 0 is given, the TTF is determined com- 
pletely by the expressions (8.3) and (8.4). We will consider a problem of estimating TTF 
under the condition that the values of all or portion of the parameters are unknown: instead 
of the values of the parameters @,, their intervals of uncertainty {@/. 0”) are given, or in a 


general case, a prior p.d.f. hg(@) is known. 


8.1.1 Setting of the problem 


The problem of obtaining TTF estimates is solved under the following assumptions: 
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(1) A working capacity model of the form (8.1) is known and appears to be ideal, i-e., it is 
free of errors; 

(2) Given satisfactory, from the point of view of engineering exactness, expressions for the 
p.d.f’s fx (x; @) and fz(z; 0), where the values of the parameters 9 and 9 are unknown; 

(3) For a vector of parameters @ (or v) given a prior p.d.f. hg(@) (or hy(d)); 

(4) During the tests, the values of the initial variables are fixed; the set of these vari- 
ables will be denoted by x= ea; where i = 1,2,...,N is the variable number, 


ji — lh2 eee nasithemtesunumben 


The phrase “are fixed during the tests” means that the parameter value may be measured in 
the test or it is a priori assumed that in the test the parameter takes on a certain value. 

The problem is to Bud the pointwise TTF Bayes estimate, R*, the posterior standard de- 
viation, Og-, and Bayes lower confidence limit, R}, under the given confidence level, ¥. 
The general solution will cover two cases: in the first one, a prior p.d.f. hg(@) of the pa- 
rameter vector of the initial variables X, in the second case, hy»(0) for the vector of state 


variables Z. 


8.1.2. The solution algorithm in case one 


Let us write the likelihood function for the known p.d.f. fx (x; @) using the sample of results 


X = (x},x2,.-.,Xn). Since x are noncensored data, we have 


n 
éx(@|x) =] [fx (xj: 9). (8.5) 
j=l 
Now we return to the traditional Bayes scheme. Using Bayes theorem, we obtain the pos- 
terior p.d.f. of the parameter 6 
ho (0 | x) ~ ho(@)ex (8 | x). 
Thereafter, in accordance with the standard Bayes scheme, we can find the pointwise esti- 


mate 
C= arg min {G(6)}, 


where G(@) is the function of a mean posterior risk. In particular, if a mean square error 


loss function has been chosen, we have 
6 = [ @no(9|x)d0, 1=1,2,...4k. (8.6) 
(0) 


Note that the Bayes estimate 6* is determined by the sample x, a prior p.d.f., hg(@), and the 
form of the probability distribution fy (x;@). The Bayes TTF estimate may be found with 
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the help of the obtained estimate (8.6) as R* = Ry (6) where the form of this dependence 
is defined with the help of the integral (8.3). The estimate Ry (6°), generally speaking. 


may be biased. Therefore, the estimate of the form 
ke arg min i L(R(@), R)hg(@|x)dé0 (8.7) 
JO 


is more preferable. Here L(R(@). R) represents a loss function. For a mean square error 


function we obtain 
R = | Rx(@)ho (6 | x)d0. (8.8) 
(o) 


Comparing the expressions (8.8) and (8.3), we may draw the conclusion that the calculation 
of the estimate R* is connected with the evaluation of the (N + k)-dimensional integral. The 
error in defining the estimate (8.8) may be represented in the form of the posterior mean- 
squared value of the function Ry(@). This approach allows us to find the Bayes lower 
confidence limit Ry for a TTF with a given confidence level y. To do this we need to solve 


the equation 


i h(0 | x)d0 = y. (8.9) 
Ry (@)>R* 


8.1.3. The algorithm of the problem in case two 


Suppose that we are given a prior p.d.f. A( 0) of the status variable Z = (Z).Z>..... Zi). 
Having the system of working capacity functions @,(-) (see assumption (1)) and sample x. 
we may obtain the set of experimental values of the status variables dest SS) Se. - ae) 
(i is the test number, j is the variable number), where z,, = @)(X,). 00° 1. 2.....m j = 
| 2s M. The reasoning is similar to that for the first case. For the posterior probability 


density of the parameter 0 we will have 
h(d|z) ~h(d)ez(8|z), (8.10) 
where 


éz(8|z) =|] fe (zis) (8.11) 


For obtaining TTF estimates we should use the common integral (8.4). This may be done in 
the following two ways: with the help of the posterior estimate 3* or directly, by estimating 
the function Rz(%). With mean square error loss function in the first case we have R* = 
Rz(8*), where 


8; = [, 9n(0 |2)a0. (feo @ 


Theoretical Model for Engineering Reliability 223 


and @z is the domain of changing of the parameters 7. In the second case, 


Ae 0 M oD 
MS i Rz(8)A(d | z)dd = rt A(d | z) | | f2(z; 9)dz. (8.12) 
@z @, ~ JO eho 
The expression for the posterior variance of the TTF, which appears to be a characteristic 


of the accuracy of the estimate (8.12), may be represented in the form of an analogous 


integral: 
op. =f R2(9)A(0 |z)dd = R®. (8.13) 
Zz 


The equation for obtaining the Bayes lower confidence limit in the case when the prior 


density h(2) is given has a form similar to that for the equation (8.9): 


i) h(d|z)dd =. (8.14) 
Ry(8)>R% 


Comparing these two cases we note that their corresponding estimates coincide only in the 
case when there is a correspondence between the hg(@), and h(1) reflecting adequately 
the dependence 0 = 0(6). At the same time, these estimates differ between themselves 
if a priori information on parameters @ and ¥ are obtained independently, starting from 
different prior arguments. The question about the choice of the form (hg(8) or h(d)) 
of a prior distribution probably cannot be solved uniquely. On one hand, since hg(@) 
determines the prior distribution of the parameter, characterizing the initial variables, we 
have more various a priori information than information for 4(v). On the other hand, the 
calculation scheme which uses h(®) will be simpler, since the dimension of the vector %, 
as a rule, is much less than the one for the vector @. We will prefer the second calculation 
scheme, assuming that the prior density h(@) may be found with the help of the probability 
density hg(?). 

In the last two sections we have solved the problem of estimating TTF for the technical 
device having a working capacity model represented by one inequality of the form (8.1) for 
the Gaussian distribution of a status variable. The solution is carried out in an ascending 
order, that is, at first we consider a simpler case of the known variance of a status variable 


Z, and thereafter, we investigate the general case when all parameters are unknown. 


8.2 Reliability function estimates for the known variance of a status variable 


Let a device TTF be defined by a single status variable, obeying a normal law with the 
p.d.f., fz(z;mz,Oz).Then, in accordance with the general expression (8.2), we have 


R = R(mz, 62) -0(%), (8.15) 
OZ 
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where ®(1) is the Laplace function. This case may serve as an approximate description 
of a one-dimensional model of survival time of the form Z = @(X).Xo..... Xv) 2 0. when 
one uses a normal approximation of a probability distribution of the status variable Z, the 


parameters mz and 67 can be found approximately by the formulas 


B*o(mx) | 
(myx) aoe: jj 010}, (8.16) 
5 dm;bm,;" : 
and 
ae 2 
07 = {o(mx) — mz] 
0O(myx) BoO(m 076(m 
i {are vex) OS) + [0(me) —mz\ PO p,,0,0; (8.17) 
I<IejEN Om; om, vm, Bm, 
where iy = (ajo. my) is a vector of mean values of the initial vanables X. oy = 
(0),...,Oy) is a vector of the standard deviation values of X. py = {p,,;}\.. is a matrix 


of correlation coefficients of the vector X. The set (y.Ox. Py} generates the parameter 
vector 0. 

Here we consider a particular case when the variance of a status variable is known, i.e. 
we assume that the parameter dz is completely known, whereas for mz. we know the 
uncertainty interval [@, @2], on which the a priori distribution is detined with density fi 3), 
Often we meet the situation when it is difficult to substantiate the form of the density /1 0) 
in the interval [@.Q2]. Therefore, following Jeffrey's approach, we use a uniform prior 


distribution 


= ee, Op Se 
A(d) = < a — a (8.18) 


0, OZ Ohn 1) Sa0ap 


Now, since the parameter 67 is a priori fixed. the p.d.f. of the status variable Z is written as 
fo (2: 9) = ee OF / (204) (8.19) 

V 2G, 
Let us use the general scheme described in 8.1.3. First we shall find the likelihood function. 
Suppose 2 (2).52.....2v) 18 the sample of results of independent tests. Moreover, in view 
of the,assumptions (1) and (4), 6; @(x;). fw 1. 2..... n. In accordance with the general 


expression (8.5) for the likelihood function, 


] 
e(8 |z) = ——.— exp |-—, (nv — 2nv av 
(8 |z) | 763 \" ) Sanit en )| 
~ exp - 763 (0? — 2nv, °)| ; (8.20) 
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where vy; = (zi +2+--° +zh,)/n is the k-th statistical initial moment. With the help of the 


relation (8.20) we can write the prior p.d.f. conjugate with a likelihood kernel as 
i 
h(3) = h(d; a), 2) ~ exp [sop (av? ao), (8.21) 
Z 


which depends on two parameters. Using the relations (8.20) and (8.21) together with the 
Bayes theorem for the posterior p.d.f. h(0 | z), we obtain 


1 
h(d0|z) ~exp [shy (av? — a\2)| ; (8.22) 
= 207 
where @) = 0% — 2vin, a = Q +n. If we have chosen the uncertainty interval [a , 0] and 


put @, = @ = 0, then the prior density (8.21) is transformed into the uniform one (8.18) 


associated with the posterior probability density 
h(d|z) ~ exp [say *-2n2)| , a <BvKmH (8.23) 
ze 


Let us note that for practical calculations it is better to use (8.23) than (8.22), because we 
can address serious difficulties connected with the choice of the parameters 0, G2. 
Define the Bayes prior estimate 3* as the posterior mean value. The resulting expression 


will be obtained after certain cn and results in the form 


Oz e 4/2 ud /2 
eo =v, + = —_—___—_ (8.24) 
oe I 
where uz = (Qj —v1)./n/Oz, k = 1, 2. 


Let us study the obtained estimate. At first, 3b* — v; as n— ©, ie., the Bayes estimate 
converges asymptotically to the maximum likelihood estimate. Consider the symmetric 
prior interval [89 ~u, Up + uj, where Up is a center point. In this case, uy = (Bp — u— 
v1) J/n/Oz, ur = (Wo +u—v,). If the sample mean vy; is near to Vp, i.e., the test results 
are well-consistent with the prior information, then |u;| = |u2| and 3* & v,. Suppose now 
ul — oo, that corresponds to the case of absence of a prior information about the parameter 
0. Then, for any n, we have |u| — cc. Consequently, 3* — vj, i.e., the Bayes estimate 
coincides with the asymptotic sample mean value. 
To find the posterior variance of the parameter 0, we apply the expression for the posterior 
probability density (8.23) and write 

OF. = [ 8°n(0 |2)40- 3" 
After the necessary calculations we finally get 


lo a oe 
Oh = ae ay omy R(t 


2 2 2 
0. ~u4 /2 uf /2 
+2 (et? 28 4/2) +2 (me ewe”? )} (8.25) 
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Note that as n — 0, 63. — 0. 
The approximate pointwise TTF estimate and posterior variance of this estimate may be 


found with the help of Kramer’s theorem [132] 


i Be I 1 abate oie I 
R -0(=)-0(2), Op. weer oo( 2] Cx -o(s5). (8,26) 


For practical use of the dependencies (8.26) one should omit the terms Ovl a) and 


O(1/n*/*), which, generally speaking, may be done only for large n. 
The TTF estimates can be found exactly if we use the general expressions (8.12)-(8.14). 
The resulting expressions for R* and 65. have the form 

‘ U; U2 


a ———_—-__ — R*?, 8.27 
R @(u) — B(u) and OR. ~ Sgp=aoa) -R = 


I —u? /2 
Ups = [ve (= af 2) e dit. 


The given scheme has an obvious shortcoming. The integrals LU, cannot be represented in 


where 


a finite form and, therefore, we have to apply methods of numerical integration. Numerous 
calculations emphasize the coincidence of exact and approximate formulas for > 20. 
Consider now the problem of obtaining a Bayes lower confidence limit of the TTF. Princi- 
pally this problem can be reduced to the solution of the equation (8.14) for the prior density 
having the form (8.23). In view of the monotonicity of the Laplace function. this problem 
may be solved in the following way. Let us find the Bayes lower confidence limit B, of the 
parameter 0%. To do this, it is necessary to solve the equation 


[one |z)dd—y=0, 


= 
which may be rewritten in the resulting form in the following way: 


P(uy)(1 — 1) + peu) 0 (=r) = 0. (8.28) 


Now the desired estimate may be obtained with the help of the simple formula 


3 : 
* =a) ; 4 
R= (=) (8.29) 


8.3. General estimates of the reliability function for a one-dimensional model 


8.3.1 Formulation of the problem 


In this paragraph we will give a generalization of the previous result for the case when a 


prior information about the parameters mz and Oz is uncertain. In accordance with the 
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notations used in this chapter, we let 3; = mz, J) = 6z, and represent each parameter 
as a sum Oj = Vo + & k = 1,2, where Yo can be interpreted as a theoretical value of 
the parameter, which is assumed to be given in the Bayes procedure and & represents 
the deviations from the theoretical value. Suppose that prior p.d.f.’s hy (€;) and h2(€2) 
are known. For the purposes of practical application of this procedure, it is useful to use 
uniform prior probability distributions: 

1 

pee ae (8.30) 
0, & < ewe e. 


Now we can formulate the problem of obtaining Bayes estimates of TTF in the following 
way. The TTF is represented in the form of a function depending on the quantities €; and 
€, that is, 

® 


woe | (8.31) 


R=R(€),€2) = ® | ————_ 
(€1, €2) —_ 


We are given a priori information about the parameters €), €2 in the form of a prior p.d.f., 
h(€),€2). Also, n tests have been carried out. During these tests we determine directly or in- 


directly the values of a status variable Z. These values generate a sample z = (z),22..-.. zn). 


The problem is to Bud the Bayes estimates of TTF in the form of a pointwise estimate R*, 
posterior value of the standard deviation, Og. and Bayes lower confidence limit Ry. For the 
solution of the problem we use a standard Bayes procedure. 

Let us write the likelihood function /(€), € | Zi In accordance with the chosen parameter- 


ization, a p.d.f. of the status variable has the form 


I see 

5€),€2) = ——=———- exp | - | - 8.32) 

Ff (z5€1, €2) Tass es P| 20+) ( 
Using the general expression (8.11) we obtain 
| ] 
€(€1,& | z) - (2x)r/2 : (do + &2)" 
n 2 

EXP | sega [2 — 21 ( B10 +01) + (10+ 81) i}. (8.33) 


The obtained estimate of the TTF is based on the prior p.d.f.’s Ay (€)) and A2(€2) of the form 
(8.30), ie., we will assume that the set E = [e}, €/'] x [€5, €4] appears to be the unknown 
domain of the parameters €; and €2. In accordance with the Bayes theorem, for the posterior 
probability density of the parameters €, and €) the following relation holds: 
h(e1,€ | z) ae ili exp { eS Zant oct) ua me x } 
= + €2)" 2( B29 + &2)*/n 
(€),€) EE. (8.34) 
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We will distinguish the simplified and main schemes of the solution of the problem. The 
choice of the scheme is connected with the type of loss function, used in the Bayes proce- 
dure. In accordance with the simplified scheme, the loss function is chosen with respect to 
each parameter separately. The complexity of the scheme depends on the choice of the loss 
function for TTF, R(€), €2). 


8.3.2 The simplified scheme of the solution 


This scheme starts with the finding of the parameters €; and €2 which are used for obtaining 
TTF estimates. We will carry out the estimation of each parameter by minimization of the 


posterior risk function for the mean square error, i.e. 


gj = aremin [ (€; —&;)° h;(e; | z) dey, Te, » Oe) 
where the marginal posterior densities are obtained in the usual manner: 
hy (€ |z) ~ [ rleres)? ale: |z)\d&, e<a<e (8.36) 
and 
hy (€ |z) ~ [i nler,e0)? mere |z)de, <a <e. (8.37) 


The solution of the problem (8.35) is known [202]: 


J 

e =f? SEp lL Gein fee (8.38) 

j 

The complicated form of the relation (8.34) doesn’t allow us to hope that the final results 
will have a simple form. The reason is that the kernel of the posterior probability density 
h(€),€) |Z), determined by the right-hand part of the relation (8.34), cannot be integrated 
in the final form with respect to any of the parameters. Use of the Laplace function P(1) 
lets us reduce the resulting expressions for the estimates to the one-dimensional integrals 


and represent them in the form 


ol eI n(v2— v7) 
£& men . 
pe “a oul | 
. 2 2 
y uy (y) ) us (\) ) 
ex = 7 dy. 8.39 
Kemp (8) exw (2) has. (aay 


uw y 
eae A tn y— tho | n(v2 — v7) 
& = ———— exp | — 

9 


x (¥) = Di0) + 


and 


[P(u2(y)) — P(ui (y))l dy (8.40) 


2\2 
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where 
oy n(v2 _ v2) 
B= [2 serexo| MD) tay) — emote 
0,=09+8, vf =00+eh 
Vin 


in) = (Bote) +r) and u(y) = o (do +e/ +n) (8.41) 


Analyzing the expression (8.39), we see that for vj = 319 the Bayes estimate &f equals zero. 
This fact has a logical explanation. If a sample mean value v; coincides with the predicted 
theoretical value of the mean mz (the center of the interval of a prior information), then the 
value, whose role €; plays, must equal zero. 

2 


Define now the posterior variances 04 


D . 
és and Of: of the parameters €, and €2, respectively. 


Let us use the general expression 
C= ig &h(e1,€2|z) =dejde,—6, j=1,2. 
j E 


The resulting expressions for the variances also may be written with the help of one- 


dimensional integrals, having the following complicated forms: 


1 fe 1 n(v2 —v? y2 
G2 = ; exp a é 2] {fo = oo) +2 | 


B of yn! 2y2 
’ 2 2 
x [Bun(9)) ~Blan(9))]+ ZZ (o ~ do) [exp (—A2) -exp (—222)] 
2a, 2 
ae c (exp (- a0) — u7(y)exp (-2) ay er (8.42) 


and 
1% (y— Bo)" n(v> — v? 
er fe ae ce 
BJo  y” 2y 


The final goal of this procedure is obtaining the pointwise Bayes TTF estimate and posterior 


[P(u2(y)) ~ (u(y) )]dy— 87. (8.43) 


TTF variance Oj. To this end, we apply Kramer’s theorem for the function of statistical 


estimates. In conformity to this case, Kramer’s theorem has the form 
és Vin +f | 
w= 0( =) +0(5) (8.44) 
29 Ar 5) n 


1 
2 ae! rr..." 
ae (20 + €3) = 


o2. + OMT 9 ayy OT Ee |.) (8.46) 
é ae & Apa. UG? 3/2 
D2 + € (929 + 8) n 


and 


(8.45) 
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where Ke, ¢, is the posterior correlation between the random variables €; and €2. The nu- 


merical characteristic 1s defined by the integral 


Kees ff evern (eres | z de, den — ef 8). 


Finally 
1 pr yy n(v2 -47 ; 
Kee = B whe ; yl = EXP ane u {(@(a) — B(u;(y))} 
3 2 
y u*(y) us{y) 
x (Vy 80) + exp (= z ) exp (~ zs has (8.47) 


Therefore, defining the estimates R* and O;. requires evaluating six one-dimensional inte- 
grals (8.39)-(8.43) and (8.46) by numerical methods. The value of the lower Bayes con- 
fidence limit can be found approximately, with the help of approximation of the posterior 


probability distribution of the TTF by a beta-distribution Be(a.b) with the parameters 


. (ROR) [RR 
a = R* | +A — - 1] and b = (1-R*) | ——— - 1 
On. Op. 


Later we will need to either solve the transcendental equation 


i b-I 
jae (123) aa), 


or use the finite expression 


b —| 
Ry = (1 ‘ei wi 2h20) ; 


where Fy.5,:5, is the @-th percentile of the F-distribution with 0; and 6: degrees of free- 
dom. Note that the calculation procedure described above doesn’t give us any difficulties 
since the numerical methods of one-dimensional integration and the solution of transcen- 


dental equations are well-developed for computer implementations. 


8.3.3. The main calculation scheme 


“ ay? 
This scheme deals with the mean square error loss function L(R.R) = R(€\-&) R| and 


gives the Bayes TTF estimate of the form 


a= | | Ree)W(e.e|\z)deder 
E id 


The handiest numerical representation of this integral has the form 


P 1 fn fp re x\ 1 vy — 2vyx4x7 
R= =,/— \ / P| - | —e — ——.——_ J dxad\. 8.48 
BV 2m Jor ty (;) “ esp 2y-/n = — 
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where 3% = dko + &, Of! = Dio + &/, k = 1, 2. The posterior variance is determined by a 
similar ie 


Bo i ae v2 — 2vyx+22 a) 


As seen from the expressions scan and (8.48), for obtaining the Bayes estimates we, un- 
fortunately, cannot avoid the double numerical integration. Only the fact that the integration 
intervals [9,81], [9,84] are small and the integrand on these intervals is sufficiently 
smooth is encouraging. Because of these properties we can use the simplest methods of 
numerical integration of the rectangular lattice. In the case of a large interval, we need to 
apply more complicated approximating formulas. 

Evaluating the lower Bayes confidence limit, we mun into serious calculation difficulties. 


To find Ry we need to solve the following equation 
: | h(€, €2 | z)\d€; de) —y=0, (8.50) 
oJ (R;) 


where the integration domain Q(R}) is an intersection of the set E = [e,,e)] x [e},€4] 
with the set of the parameters €, and €) for which the in-equality R(€),&2) > R;, holds, 
few Ry lies in the integration domain. With the help of the new variables x = 09 + €; and 


= U9 + &, (8.49) is given by 
| v2 — 2vyx+22 
— ———_.———__ ] dx dy — yB = 0. 8.51 
// ro 2y?/n ) at Sie 


The idea of solving the equation (8.50) based on using one of the standard numerical meth- 
ods of solution of the equation F (uw) = 0, where, for each value u, evaluation of the integral 
is carried out not over the whole rectangular [0/, 0//| x [04, 84] but over such a part of it 
that ensures the fulfilment of the condition ®(x/y) > u. Taking into account the monotonic- 
ity of the Laplace function, we resort to the following simplification. Instead of equation 
(8.50), we will solve the equation with respect to the quantile of a normal distribution, 
pS Me) which corresponds to the unknown probability R). Since the inequality 
@(x/y) > B(v) implies the fulfillment of the inequality x/y > v, the equation (8.50) is 


equivalent to the following one: 
V5 =e 
—_——,——__ ] dxdy — yB = 0 8.52 
Le so( 2y*/n ) axay—rp saa 
a( R) 


in which the integration domain Q2(v) represents by itself the intersection of the rectangular 


[91,91] x [04,84] with the domain of values of x and y satisfying the inequality x > vy 
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(see Fig. 8.1). Thereafter, we can rewrite the equation (8.51) in the formal form F(v) = 0 
and solve it by one of the standard methods. In this approach, we should take into account 
the fact that the unknown value v lies in the interval (0; /05. ¥,'/05. This fact is easy to 
verify (see Fig. 8.1). After the equation (8.51) has been solved, the desired estimate of Ry 


may be obtained from the formula R} = P(y). 


Fig. 8.1 Integration domain for (8.51). 


8.4 Examples of calculation of the reliability estimates 


In this section we give examples illustrating the particulars of estimating Bayes procedures 


of the TTF with undefined initial data. 


8.4.1 Calculation of TTF estimates of a carrier construction 


Consider the construction of a bar depicted in Fig. 8.2. We have chosen this construction 
because its working capacity model has a simple form and is, apparently, error free. Both 


bars have an angle profile and are made of steel. The relation of the acting forces is such 
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that the first bar is expanded and the second one is contracted. The set of lifetime conditions 
includes [23]: 


Fig. 8.2 An element of the construction under the static load. 


The condition of durability of bar 1: 


+ 
Zi = 61(or,Fi,Q1,Q2) = ork - 2+ 5 0, (8.53) 
V2 
the condition of global stability of bar 2: 
WE J, O2-Qi 
Zp = 2 (4, Ep, J: = — : : 
2 = b2 (0, E2,J2,Q1,Q2) DB Fi eu; (8.54) 


The condition of local stability of bar 2: 


p0. (8.55) 


2 
Z3 = 03 (E2, 2, d2,b2, F2,01,Q2) = PMC @ = a 
The inequalities (8.52)—(8.54) are used as follows: F represents the cross section area of 
the bar, / is the moment of inertia of the cross section, pd is the Poisson coefficient, E is the 
elasticity module; O7 is the fluidity limit of the material, indices | and 2, correspond to the 
bar numbers. The calculation of the project (prior) value of the TTF has been carried out 
with the help of (8.15), where the numerical characteristics mz and Oz were obtained in 
accordance with the expressions (8.16) and (8.17). The initial data used for the evaluation 
of the construction reliability are given in Table 8.1. The arguments of the working capac- 


ity functions and status variables are assumed to be independent. The calculation results 
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Table 8.1 Results of evaluation for project TTF estimate. 


Number of working 


m. H R, 


conditions 


1.64-10° | 0.536-10° 


0) 9997 


for TTF are shown in Table 8.2. The construction TTF as a product of probabilities of 
fulfilment of each condition of the working capacity equals R, = 0.9628 

The TTF estimates under the given variances of the status variables were obtained with the 
help of the scheme of § 8.2. For obtaining Bayes estimates of the probability for every con- 
dition to hold, we use as parameter 0 the mean value of the corresponding status variable. 
We obtain the following a priori information: 


For the first condition: 
de [1.58 10°H, 1.68. 10°H| , Oz = 0.536: 10°H; 
For the second condition: 
Be [0.880 10°H, 0.885 - 10°H | , Oz = 0.451 - 105H: 
For the third condition: 
BE [2.35- 10°H, 2.61: 10°H | , Oz = 0.738 10°H. 


The values of the parameters of the working capacity function have been measured during 
the 12 independent tests. After this, we have obtained the statistic v). In Table 8.3 we 
present the experimental results in the form of the sufficient statistic 1; with respect to each 
status variable. We have performed two calculations. The first one uses the method based 
on the formulas (8.24)-(8.26). The calculation results are presented in Table 8.3. The es- 
timates of the lower Bayes confidence limits for the probability for each of the working 
capacity conditions to hold have been obtained with the help of approximation of the pos- 
terior p.d.f’s by beta-distributions. The second calculation variant corresponds to the exact 
integral expressions (8.27) -(8.29). Numerical integration and solution of the transcenden- 
tal equation (8.28) have been performed with the subroutines QUANCS8 and ZEROIN [86]. 
The results of the calculations are presented in Table 8.4. It follows from the comparison 
of the data from Table 8.3 with those from Table 8.4, that the method of approximating 
and exact estimating gives us practically the same results. The calculation of a lower con- 
fidence limit of the construction of TTF has been performed with the help of the approach 


proposed in [247]. For the result, the estimate Rj 4 was obtained. 
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Table 8.2 Bayes TTF estimates with known variance (approximate method). 


Number of working 


conditions 7 


Statistics values 


v,,H 
1.42-10° 


0.852- 105 


Number of working 


conditions j 


Statistics values 
ViG H 


Ro; 


1.42-10° 0.9988 | 0.000592 | 0.9984 


, | 
0.852-10° | 0.9667 | 0.002540 | 0.9631 
2.07-10° | 0.9994 | 0.001460 | 0.9992 


Table 8.4 A priori information for TTF evaluation. 


Number of working 


conditions 


0.536 - 10° ESE Oe 


0.828-105 | 2.7-10% | 0451-105 | 4.2-104 
3 


0.738 - 10° 


The estimates of TTF, when the variance of a status variable is unknown, have been ob- 
tained with the help of the method discussed in § 8.3 in accordance with the simplified and 
main schemes. A priori information used in the calculations is given in Table 8.5. Exper- 
imental data in the form of statistics vy; and v2 are presented in Table 8.6. The results of 
the calculations are based on the simplified scheme which operates with the expressions 
(8.39)-(8.46) and are given in Table 8.6. The estimates of TTF, according to the main 
scheme, are given in Table 8.7. For evaluating the double integral, we performed the re- 
peated calls of the subroutine QUANC8, mentioned above. As in the previous case, we 
observed a satisfactory coincidence of the results of the approximate and exact estimates. 
The value of the Bayes lower confidence limit for the subject construction was Ro 9. 


The numerical data demonstrate the evolution of the reliability estimate after the testing 


has been performed. 
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Table 8.5 Bayes TTF estimates with unknown variance of the status variable (simplified scheme). 


Number of working 


i). Hi (v> ga! POH 
conditions 


1goese 10" 0.583 10° 0.9970 Q) (00534 


0.852-10° 0.458- 10° 0.9721 (0.007200 


3 DO Ton (OP 1.204- 10° 0.9996 0.000163 0.9992 


Number of working 


conditions 


8.4.2 Calculated case “loading—carrying capability” with unknown correlation 
coefficient 


Below we present the results of the work [98] devoted to the investigation of the TTF for 
the technical device with a working capacity model of the form “loading carn ing capabil- 
ity”. Customarily in many practical situations when estimating the device reliability. we 
do not have complete information about the correlation coefficient. At the same time. the 


correlation coefficient influences the TTF value. 


Setting of the problem 


Consider an element of construction with the carrying capability ( and acting load S which 
obeys the Gaussian distribution with unknown correlation coefficient p. As TTF is used 


the following probability: 
R=P{(US ss}. (8.56) 


It is assumed that marginal numerical characteristics of the variables U’ and S are given. It 
enables us to represent the probability (8.55) in the form of a function depending on the 


correlation coefficient: 


Rear(pyese | ——eeeeillineemeemmeny) (8.57) 


V/ vy No + ¥§ — 2pvuvsn 
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where vy and vs are the variation coefficients of the carrying capability and loading, re- 
spectively, with 7 = my /ms being the coefficient margin of safety. 

We will assume that we are given an interval of a prior uncertainty [a,b] such that p € {a, 5]. 
Often in practice it is possible to establish that if the correlation coefficient appears to be 
either positive or negative, then we may put correspondingly p € [0,1] and p € [—1, 0}. If it 
is known that there exists a weak stochastic dependence between U and S, we may suppose 
that p € [—0.5,0.5]. Let us choose a uniform p.d.f. A(p) on [a,b]. 

The problem is to obtain the Bayes estimate R* for the probability (8.56) with the given 
prior probability density h(p), defined on [a,b]. 


Bayes TTF estimates 


Following the general scheme of Bayes estimating, the pointwise prior TTF estimate may 


be written in the form 


1 b 
a 
Here we can obtain the resulting formula in the analytical form 
(eal): 
R* = ———_——__(F(v) -F ; 8.59 
pam (8.59) 
where 
lee) Te 
= ae Ee er re 
(vz? + v2 — avy vsn) (v2.2 + v2 — 2bvuvsn) 
and 
poe ene) x)= | (06) 
ae OTs 2 
with 
1 2 
Bie eee! 
(x) = 


The posterior TTF estimate R* for the uniform prior distribution law is written as 


ela aeRO) 1 E Oy s <3) 

ge: te) ay Biers =| bap, 8.60 

i | Cog WL) a al 
hax 


where f is a constant coefficient having the form 


b ] | oj, Mus we 
= exp. ————>~ | —+ — 2x - 
: l (leswee ye" ° 261 ae) é Oyds oe 
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The probability R(p) is defined by the formula (8.56), and sufficient statistics Oe. ON and 
@ys by the following expressions: 


n 


nl 
ap 2» (ut, —aeiy |" we ad Sy (s, =m)". 
jaw] re! 

and 


Ous = (uj = my ) (si = ms), 


where (uj, si) is the set of pairs of experimental values of U and S. 
In contrast to the analytical procedure of evaluating a prior TTF estimate (8.58). the poste- 
rior estimate (8.59) may be found approximately with the help of the methods of numerical 


integration. 


Comparative analysis of different estimates 


In practice for obtaining a prior TTF estimate, one often uses the following formulas: 


i 
Reed fee |. (8.61) 
(ee try 
and 
—| 
eee : (8.62) 


4 3) 
Viy n+ V5 — 2PcxVuVsN 


For obtaining the estimate Ro, we put p (0): the estimate Rx, have been obtained under 
the assumption that the correlation coefficient equals the midpoint of the segment of prior 
uncertainty: P = Pex = (a+ b)/2. In [98] a numerical comparison of the estimates Ry and 
R-x with a prior Bayes estimate of TTF R* of the form (8.58) has been carried out. The 
calculations have been performed tor vy - vy = 0.1, different coefficients of a margin of 
safety 7 = 1.1, 1.2. 1.3. 1.4 and different lengths of uncertainty coefficients J = b-a = 
O5002, 04... giles, 2.0. 

In Fig. 8.3, itis shown that the dependence of the relative difference of a prior Bayes esti- 
mate on the TTF estimate with zero correlation (R* — Ro/Ro) for the uncertainty segment 
(—a,a], when Ro and R,.« coincide. By increasing the coefficient of a margin of safety 
7, this relative quantity decreases substantially. For example, for the maximal interval of 
uncertainty (J = 2) (R* — Ro)/Ro it reaches ~ 4.3%, for the uncertainty interval having 


the length which is half smaller (j = 1) is 0.7%. We note also one additional important 
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Fig. 8.3. The Relative Difference Between R* and Ro = R-x. With Symmetric Interval of Uncertainty. 


property: if 7 < 1.25, then for all J the Bayes estimate R* is always greater than Rp, and if 
7 < 1.25, then R* < Ro. 

In Fig. 8.4 we represent the patterns of change of relative difference for all three TTF 
estimates for the asymmetric interval of uncertainty when the upper limit of the segment 
is fixed (b = 1). As seen from the graphs, the roughest TTF estimate is Ro, which can be 
used only for large margin of safety (7 > 1.4). The estimate R..x approaches near to R™, 
beginning already with n = 1.3. 

The posterior Bayes estimates have been illustrated with the help of the numerical example 
in [98]. As initial data, the following values of dimenstonless coefficients were chosen: 
vy = vs = 0.1, n = 1.3, and p € [—0.8,0.8]. In this case, the Bayes prior estimate of TTF 
equals R* = 0.906214. 

If one defines the posterior estimate (8.59), it is desirable to choose the following statistics: 
a = CORR ee = w/o%, and €ys; = Wys/Os.The calculations have been done for the 
following hypothetical testing results. Ten tests have been carried out. During these tests 
we have measured the values U and S. Moreover, the test results are such that the corre- 
sponding marginal statistics €7, = 9.5 and ef = 10.2. Three cases have been considered: 
ee) (positive correlation), gt = 0 (absence of correlation), Oe = —5 (negative cor- 


£us 
relation). For these cases, in Fig. 8.5 the posterior densities h.(p), fo(p) andh (p) have 
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Fig. 8.4 The Relative Difference Between R* and R,): (a) and in Addition Between R* and R 4.16) with Asym- 
metric Interval of Uncertainty. 


been constructed. As seen from Fig. 8.5, for the positive correlation the density biases to 
the right, for ey. vice-versa, to the left. Corresponding posterior Bayes TTF estimates 
equal R*, = 0.902966, Ri, = 0.90016 and R*_ = 0.89694. 

The result given above lets us more correctly (in comparison to the existing approaches) 
establish the prior Bayes estimate of the TTF probability under the conditions of uncertainty 
with respect to the correlation between the loading and carrying capability, and correct this 


estimate by the testing results 


8.5 The statistical design optimization based on the Bayes approach 


The settings of the solutions of the problems of probability optimal projection are well- 
known [112, 120, 173, 193]. The distinctive characteristic of the proposed problem setting 
is that the optimization process deals not only with the project reliability estimates, but also 


with the results of the consequent experiments. Project contents itself is in favor of such an 


Theoretical Model for Engineering Reliability 241 


Fig. 8.5 Posterior p.d.f.’s for different correlation coefficients. 


approach. Project parameters are chosen with the help of existing working capacity mod- 
els of the type (8.1), engineering experience and a priori statistical information about the 
loadings, physical-mechanical characteristics and geometrical parameters. Thereafter, one 
carries Out an experiment which confirms the principal working capacity of the device, the 
reliability estimates are defined more exactly, and innovations are put into the project to sat- 
isfy reliability requirements. The union of a project (prior) and experimental information is 
among the most important elements of this chain of measures. To this end, we recommend 
using the Bayes approach. Below we give one of the possible ways of the Bayes statistical 


optimization. 


8.5.1. Formulation of the problem 


Suppose the device structure is defined and the problem is to choose the values of controlled 
parameters generating a vector @ which ensures the extreme value of some parameter of 
quality. It is usual that the nominal values (or mean values) and dispersions (or mean- 
squared values) of some geometrical parameters play the role of controlled parameters. 
For the sake of simplicity throughout what follows, we will assume that the designer cannot 


vary the loadings, and data are chosen for more general reasons. In practice we often meet 
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the situation when a designer can choose nominal values of geometrical parameters which 
have given dispersions determined by technical documentation (GOST, industrial standards 
and norms). Thereby, a problem of optimal projection includes as a rule a choice of mean 
values of some determined part of parameters generating by themselves the vector @). 


The considered optimization problem includes three component parts: 


1) A reliability model which is reduced to the establishment of a relationship between the 
Bayes estimate of TTF, R° (or Ry) and vector of control parameters @. Later we will 
write R*(@); 

2) Technical and economical characteristics (mass or cost) in the form of a function S = 
S(@) (or set of such characteristics); 

3) Additional restrictions of the form w(@) <O(f = 1.2..... L), guaranteeing the physical 


reliability of a project and establishing the norm and relationship of a projection. 


The problem may be formulated in two different ways when one optimization criterion is 


chosen: 


Direct problem: 


R*(@)— max. 
S(@)< Spo, (8.63) 
Wi(@) < 0. Paige .aals: 


Inverse problem: 


S(@) +min, 
R*(@) > Rreq, (8.64) 
< 


Considering a direct problem, we assume that a threshold value of the characteristic So is 
given, whereas in the inverse problem a required Ryeg. by the technical documentation, TTF 
value is known. The technical-economical characteristic ts usually chosen in the form of a 
cost, sometimes in the form of an object mass, and the representation of the function (@) 
doesn’t present any difficulties. The main obstacle in this action is obtaining the depen- 
dence of R* from a vector @. Let us investigate the following question: in what way can 
the parameter @ be introduced into the Bayes scheme (for example, as described in § 8.3)? 


From the arguments of § 8.1, we conclude that a Bayes TTF estimate is defined by: 


1) a sample of testing results x in the form of a vector of initial variables X; 
2) a form of a p.d.f. fx (x: 0); 
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3) a form of a working capacity function @;(-), j = 1, 2,...,M; 


2 


4) a prior probability density h(@) of the parameter vector 0. 


A vector of controlled parameters @ is naturally included in the Bayes scheme in connec- 
tion with a prior density h(@) as some subset of the set @@ with the help of which a prior 
density h(0; 0g), %@ € A is parameterized. Suppose, for example, that a vector parame- 
ter 6 consists of mean values m; of all (in practice only some of them) initial variables, 
1.e., 8 = (m),mz,...,my). A prior distribution density h(@;Qo) appears to be uniform. 
Moreover, each of the parameters 6; = m; is distributed inside of the interval pt; = [m/,m/], 
i= 1,2,...,N. The interval p1; is determined by the mean value mjo and relative length 
Xi so that m; = mio(1 — x; /2), mi! = min(1 4+ 4;/2). The set mio, x; (i = 1, 2,...,N) forms 
a vector of parameters Qg. The quantity 7; determines the degree of uncertainty, impos- 
sibility to ensure a theoretical value mjo in practice. At the same time myjo is such a new 
value of the i-th initial variable (as was mentioned, of a geometrical parameter) which 
should be chosen by a designer in the process of a solution of the optimization problem, 
Les © = (gi... myo). Including @ as a subset of & into the Bayes procedure, we 
obtain the relationships between the TTF estimates, R* or Ry, and a vector of controlling 
parameters @. 

The algorithm for the solution of the optimization problem consists of the following steps. 
At first, before the testing, the problem (8.62) is solved under the assumption of absence 
of experimental data. Thereafter, while the data x are accumulated, we repeat the problem 
solution. This enables us to correct the value of the vector of controlled parameters @, 


obtained a prion. 


8.5.2 An example of solving the optimization problem 


Consider a problem of a choice of optimal project parameters for a cylindrical shell having 
a wafer type (see Fig. 8.6). As controlled parameters three mean values of the following 
initial variables have been chosen: 6’, 6, c, b.The shell is loaded by the axis compressible 
force T, a bending moment M and abundant pressure p. 


The mass of the shell is chosen as a goal function 
S(@) = S(&, 5o,c0,b0) = p {271 [ap + cohNy] +Nacoh(h — coNe) } 


where p is a material density, the index 0 denotes a mean value h = 65 — 60, Nx = [L/(bo + 
co)|, Nx = [2ar/(bo + co), [A] denotes the integral part of A. 
The reliability function is determined as the probability that the following set of working 


244 Bayesian Theory and Methods with Applications 


ALLL LIL ETN fi 


Fig. 8.6 Loaded cylindrical shell. 


capacity conditions [151]: the durability condition 
mrN 

— 8 +c(8' —8)/b 

the condition of a global stability 


nd 13 
1 oO Ge =e Ao —- O54 oO: 
a (: g V/V ) : 


MA 5 
Z| = Ov > 0, N= T+ ae BP. 


Zp = 2MkES? 


and local stability 


253 
Z3 = \2nE—— [1 +0.169'(y’ —1)] -N >0, 
—C 
where @! = 2ac/5, yw’ = 6'/6, k is the stability coefficient, oy is the durability limit. E is 
the resiliency coefficient. It follows from the working capacity model described above. the 


vector of initial variables is formed by the quantities (M.T, p.r.L.6'.8.c.b. 6y.E-k). 
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For evaluation of TTF estimate, R*, we apply a linearization of the working capacity func- 
tion. The results of optimization based on using the project TTF estimate in problem (8.62) 
consists of the following: from the initial point @ = (8,3, 100,4) mm corresponding to 
the mass S(@p) = 330.2kg and R(@) = 0.9983, the searching trajectory leads into the 
point @, = (7.3;2.8, 150,3.1) mm for which S(@») = 291 kg when Rreq = 0.99. Note that 
if a value of a project TTF estimate is chosen as Rreg, i-€., Rreq = R(@o) = 0.9983, then 
S(@) = 319.4 kg. It is seen that the optimization mass gain is more than 10 kg. 


Fig. 8.7 Dependence of optimal mass on testing results. 


The statistical optimization is carried out in accordance with the method of evaluation of 
R*(@) (see § 8.3) under the condition that uncertainty intervals form a 5% segment with 
respect to the project values m-, and o-,. The experimental results are modeled on the 
computer in accordance with the chosen distribution laws of initial variables. Fig. 8.7 


shows the dependencies of S(@p) on testing results represented by sufficient statistics 1 
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and v2. The following conclusions may be stated: (1) when the statistic 12, (the sample 
variance) increases, the estimate Ry decreases, which implies the decreasing of Sit? ): (2) 
if the statistic vj ; exceeds m-;, then S(@*) is less than the values of the goal function during 
the project optimization, otherwise, vice-versa, the value of the goal function increases. We 
have applied for optimization an algorithm of random searching together with a method of 
continuous penalty functions. An optimization problem for one sample x has been solved 
on the EC-1045 computer during a period of two hours. It is found that the second working 
capacity condition appears to be the most dangerous so that the shell TTF is completely 
determined by the probability for the second condition to hold. Due to this circumstance. 
only the sufficient statistics vj and v2 with respect to the second status variable affect the 
results of optimization. These statistics are denoted respectively by 1;2 and 12> in Fig. 8.7. 


and are given by the formulas 


n 


1 n 
Vite Y ¢2(xi) and vz = : Y oF (xi). 
35 
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Chapter 9 


Statistical Reliability Analysis Prior Bayes 
Kstimates 


9.1 Traditional and Bayes interpretations of the error of the working capacity 
model 


This chapter is a continuous development of the previous chapter, and we consider a more 
general situation when a theoretical working capacity model contains the error stipulated 
by the defects of physical theories used for its construction. Such a situation appears quite 
often in many technical devices or systems which are based on experimental data process- 
ing. In this chapter we propose a method of statistical Bayes analysis for technical devices 
directed to the estimation of the TTF for these devices and errors which are used in math- 
ematical calculations. The chapter includes the problem setting, its description and the 
solution of the problem for the stage prior to the experimental elaboration and analysis of 
the system. 

The real working capacity model is based on mathematical models in the form of finite 
analytical expressions and sets of differential equations used in the corresponding field of 
knowledge. Any mathematical model is either more or less than a complete formalized 
description of the processes and phenomena originated from the examined technical sys- 
tem. Due to this fact, a working capacity model necessarily contains the error that produces 
eventually a methodological mistake in estimating TTF. 

Very often a designer of a technical system has available only tentative information about 
the model error. In particular, for the projection of carrying construction elements and 
some other technical systems, one uses the so-called safety coefficients solving a two-sided 
problem. In the opinion of Korolev [127], a safety coefficient includes, on one hand, a 
random scatter, and on the other hand, it has to compensate for the defects of the calculation 
method, and consequently, of a working capacity model. If we use for the analysis of the 


system working capacity a representation of its parameters in the form of random variables 
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or processes, then the first aspect of the safety coefficient will not be necessary. At the 
same time, the second one remains and, apparently, completely determines the accuracy of 
the working capacity model. 

The value of the safety coefficient is chosen so as to overstate a calculation load or, equiva- 
lently, to understate the system functional capability obtained theoretically. As a result. the 
developed constructions often have extremely large weights and are very cumbersome. The 
current method of estimating model error uses information about this error (in the form of 
a safety coefficient) which is unchangeable during the system lifetime cycle. At the same 
time for the system projecting and exploitation one carries out the tests which give informa- 
tion (direct or indirect) about its real functional capability. This information may be used 
as the basis for the reconsideration of the approved prior representation of the model error. 
Coming from the logic and intention of the process of design and exploitation of technical 
systems, the error estimate of the model of functioning and working capacity must have 
a dynamic nature, i.e., it must change in accordance with the new obtained experimental 
information. It is clear also that the TTF estimate must “superintend™ the evolution of 
representation about the working capacity model error. At the initial stage of the system 
lifetime cycle, when we have no experimental data, the TTF is estimated with the help 
of a prion representation about the model error. This representation may have a very ap- 
proximate nature. During the process of experimental data processing this representation 
changes and appears to be more complete which implies the increasing of accuracy of the 
TTF estimate. 

The scheme considered above is adequate to the Bayes procedure of obtaining a statistical 
conclusion. Use of the Bayes approach for the problem solution enables us to overcome all 
specific shortcomings to the traditional method of the model error accounting mentioned 
above. In view of the optimality of the Bayes decision rules, TTF estimates obtained with 
the help of such an approach will be the best in the sense of maximization of some useful- 
ness function, and use of complete available information. 

In this and following chapters we propose a method of TTF estimation for the technical 
device which uses the error of its survival state model and a method of statistical estima- 
tion of the error in accordance with the existing testing results and a priori information. 
All arguments that we will use touch upon the case when a survival state model represents 
one functional inequality. Such a simplification has been chosen for the following reasons. 
First, this simplification is not very restrictive and serves the purposes of a clearer under- 


standing of the method. free of the complicated mathematical constructions. Second. such 
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an approach lets us investigate working capacity models consisting of many uncorrelated 
working capacity conditions. The assumption about noncorrelatedness may be justified 
since, if rough (inexact) working capacity models are used, it’s unlikely to take into ac- 
count their “acute” properties as a correlation. 

Let us give the Bayes definition of the error for a survival state model and investigate in 
what way it differs from the traditional one. Assume that a working capacity model has the 


form 
@ (X1,X2,...,Xv) > 0, (9.1) 


where X SaXieXows:....< Xy ) is a vector of an initial variable which may be random variables, 
processes or fields. A working capacity function @(-) is, as a rule, written in a special way 
as a final result of the solution of a model problem which describes the process of a normal 
functioning of the system. For example, for the thin-walled bar of the length @ with a 
minimal momentum of inertia of the cross-section J, subjected to the action of the axis 


compressible force 7, the theoretical working capacity model of the form (9.1) can be 


written as 

2 

fons] 
where E is the material resiliency module, [t is a constant depending on the bar fixing. The 
quantity 
2 
1 ae of 
Ter = ng (9.3) 


is called a critical force of the stability loss (by Euler) and characterizes a functional capa- 
bility of the bar to withstand the load 7. The vector of initial variables X is composed of 
T,E,J,¢. Since the initial variables are random, the condition (9.1) for some realization X 
cannot be fulfilled. This event is considered a failure. The probability of fulfilment of the 
inequality (9.1) during the given time interval t (or at the given time instance f) is classified 
as a time to failure probability. 

For the research connected with calculations of the parameters of the construction elements 
which don’t touch upon the probability representations, one introduces the safety coeffi- 
cient 7) compensating for the error of the theoretical model. For the considered example, in 
particular, calculation of the parameters is carried out for the force 7T as 1) > 1, i-e., under 
the condition 7., = 77 .The working capacity condition is written as 


= i 0. (9.4) 
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This survival state model takes into account. in contrast to (9.2), the error that appeared 
because of the inaccuracy of the formula (9.3). 
The form of representation of the working capacity model (9.4) may be considered as 
conditional in a definite sense. We can introduce just as well instead of the coefficient 
n. ¢ = 17! that brings a change of the inequality (9.4). For further analysis we need 
(it seems), to order the method of representation of the model error with the help of the 
quantity €, linear with respect to the right-hand part of the inequality (9.1). The essence 
of error accounting does not change in this case, and the method of construction of the 
statistical estimates of the model error and TTF is simplified. 
In accordance with our assumption, instead of the working capacity condition we will write 
g(X)+e>0 (9.5) 
The quantity € is termed an additive error of the working capacity model. This quantity 
appears to be an aggregate representation of the large number of random and nonrandom 
unaccounted factors in the theoretical model. Due to this reason we will assume that € is a 
random variable. 
With the help of this example, we show the equivalence of the additive error of the model 
and the safety coefficient. Since the last one is, by definition, nonrandom, we will use it in 
the testing instead of € only its possible limit value which, as usual. cannot be exceeded in 
real situations. In Mathematical Statistics one uses for these purposes a quantile €, of the 


distribution f;(€), represented by the expression 


fe(€)dé = p, 

which corresponds to the large probability p. Using €,, trom the inequality (9.5) we pass 
to the corresponding (but nonequivalent, generally speaking) nonrandom inequality 

¢ (mx) +€, >0. (9.6) 
where my is a mean value of a random vector. For the working capacity condition (9,2). 
inequality (9.6) takes on the form 

deat ep (9.7) 
Transforming the working capacity condition (9.4) written with the safety coefficient 7 to 


the equivalent form 


= 
(Ter) ~ Ter aU. 
we see that €, is determined uniquely with the help of 7: 


= 
Ef aa (9.8) 
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It is important to note that, since 7 > 1, from the equality (9.8) there follows €, <0, i.e., the 
additive error, as well as the safety coefficient, understates the capability of the construction 
element, obtained theoretically with the help of the Euler formula. 

Let us discuss the possible ways of assignment of €,. If a choice of the safety coefficient 
is strictly substantiated, €, is determined uniquely, for example, by the formula of the type 
(9.8). But the point is that 7 is often chosen under more general arguments which are, 
generally speaking, far from the real relationships between the real and theoretical values 
of the working capacity of the concrete investigated object. Representation of the error of a 
theoretical model has, as a rule, an undetermined nature. For example, we often know only 
that a calculated value exceeds or, vice versa, understates the real value of the functional 
capability. Sometimes we may say that the maximal error equals some percent of the 
calculated value and may be either positive or negative. Therefore it seems reasonable in 
the general case to represent the error €, not in the form of the in determined value as it 
was in (9.8), but in the form of some interval Eg = [a¢, be], assuming that £,€E,¢. Thus, as 
was done earlier, we use, based on the safety coefficient and relations of the form (9.8), the 
categorical statement of the type: the limit error €, equals — 12H, but now we assume that 
it is possible to make a more undetermined (and at the same time more flexible) statement, 
for example, €, lies in the interval [(— 12H, 0]. A designer may have, coming from his own 
experience, access to more “thin” information characterizing the chances of €, lying in 
different intervals in Eg. 

Later, using the terminology of the Bayes approach, we will say: analyzing the error of a 
working capacity model, a designer assigns a prior probability distribution h(€,), €p€Le. 
Due to this reason, instead of a given number for €,, using the Bayes methodology, we 
have some of its neighborhood (“smearing” representation of the number). The points of 
this neighborhood may have different probability significance, corresponding to a prior 
p.d.f., A(€,). Note that the determined form of representation of €, as €’, is a limiting case 
of the Bayes form, when a probability significance €,€E¢ equals unity, and a prior p.d.f., 
h(€,), degenerates into a delta-function. 

The Bayes form of representation of the error of a survival state model has several prefer- 
ences. First, it corresponds in a stronger form to give information about the model error, 
ie., to the unspecified nature of the model. Secondly, when one assigns the values of E¢ 
and h(€,), its responsibility decreases. Responsibility is understood in the following sense. 
On one hand, the object must be reliable enough; on the other hand, its construction must 


be non-overweight or superfluous in details because of its super-reliability. Usually that 


252 Bayesian Theory and Methods with Applications 


responsibility deals with only the first aspect, forgetting about the second one. 

The third, most important, advantage of the Bayes form of error representation lies in 
the possibility of correction of this representation as experimental data are obtained. The 
scheme of this correction assumes the use of the Bayes theorem. 

Finally, the Bayes methodology is attractive in the following sense. The resulting TTF 
estimate with regard to the working capacity error will always be optimal from the point- 
of-view of the minimum of the chosen loss function. In other words. choosing in the cor- 
responding way the loss function, we can achieve the desired quality of the TTF estimate. 
For example, if the object failure is connected with human victims or losses of expensive 
equipment, then for the reliability estimate of this object. the most pessimistic estimate 
should be used. This corresponds to the loss function possessing the property that overstat- 
ing is worse than understating. In conclusion, we note that estimating of the additive model 
error with the help of only one numerical characteristic of a situation in capacity of which 
the quantile €, has been used is a very rough approximation of the desired result. A more 
complete solution of the problem assumes that other numerical characteristics should be 
used. Later we will consider calculation cases based on two characteristics corresponding 


to two parameters of the p.d.f. of the additive error €. 


9.2 The problem of estimation of the additive error of the working capacity 
model attached to estimation of the reliability function 


We will assume that the object's working capacity is represented by the working capacity 


model with an additive error € of the following form: 
w(X,e) = o(X)+e>0, (9.9) 


where @(-) is a theoretical working capacity function, and y(-) is called a generalized 
working capacity function. Analogously to a status variable Z = @(X), W = w(X.e€) will 
be called a generalized status vartable.The relationship between W and Z is given by the 


linear transformation 
W=Z+E. (9.10) 


The variables W and Z may be random fields, processes and variables. For the description 
of the additive error €, we choose a model as a random variable and further on will assume 
that € obeys some distribution with a probability density f-(€) = fe(€;@), where @ is a 


vector of parameters. 
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If Z is a random variable, then TTF will be defined by the probability statement 
Ro = P{W > 0}. (9.11) 


This expression will be used as a reliability characteristic of the object in the initial or some 
fixed time, corresponding to extremal exploitation conditions. 


In the more general case, Z is a random process, and the probability 
R, =R(t) = P{W(t)>0, 0<tr<t} (9.12) 


is used as a TTF. The general problem is the estimation of the error € and TTF of the form 


(9.11) or (9.12) under the following assumptions: 


(1) The theoretical working capacity function @(X) is assumed to be given. 

(2) We are given the values of the set of numerical characteristics ky of the vector of ini- 
tial variables X. If the vector X, consists of only random variables, then Ky is formed 
by mean values, mean-squared values, correlative coefficients and, possibly, numerical 
characteristics of moments of higher order. Provided that some components of the vec- 
tor X are random processes, Ky contains additionally the parameters of corresponding 
correlative functions. 

(3) We are given the form of probability characteristics necessary for the TTF evaluation. 
In particular, for the evaluation of Ro we need to know the form of the p.d.f. or cu- 
mulative distribution function of the status variable Z. For calculation of R;, generally 
speaking, we have to know an infinite dimensional distribution density of the coordi- 
nates of the process Z(t). Under the assumption that Z(r) is Gaussian and stationary 
and the flux of intersection of the process W(t) of the zero-level is Poisson, it suffices 
to know a one-dimensional density of the distribution of the coordinates of the process 
Z(t) and correlation function of the process. 

(4) We are given a p.d.f. fe (€:@) of the additive error € and given a prior p.d.f. A(@) of 
the parameter vector 6. 

(5) We may have carried out the testing, given the information (direct or indirect) with 
respect to the values of the additive model error €. These tests may have two different 
forms. The first one is based on the establishment of the real levels of functional 
capabilities of the model. We fix the values of the status variable Z at the failure time 
(when W = Q), whence empirical values of the quantity € are found. The second form 
consists of functional tests which are carried out under the exploitation conditions near 


to them. After these tests, one can obtain censored data for €, since not all tests are 


ended by the event W = 0. 


254 Bayesian Theory and Methods with Applications 


Under the assumptions (1) (4), the problem of obtaining a prior estimate 1s solved. The 


general scheme of the problem solution can be represented by the following three steps. 


Step I. Determination of the conditional TTF, R = R(@), depending on the parameter vec- 
tor which characterizes the additive error €. This step uses the assumptions (1 )-(4). 

Step 2. Determination of a prior TTF estimate with the help of a prior p.d.f.. A(@). and 
some loss function L (R.R). Assumption (4) will be methodologically fundamental for 
this step. A TTF estimate is sought in the form of a pointwise estimate. R*, minimizing 
a prior Bayes risk and a lower prior confidence limit, R}. under the given confidence 
level y. 

Step 3. Determination of the posterior TTF estimate by the results of the experiment men- 
tioned in assumption (5). Here we use the Bayes theorem which enables us to find a 
posterior density of the distribution of the vector 6. As discussed earlier, information 
about TTF is formed by the pointwise posterior estimate. R°. minimizing posterior 


Bayes risk, and posterior lower confidence limit, R}. 


Note that the first step is free of the use of principles of the Bayes methodology. We will 


consider it in § 9.3; Steps 2 and 3 will be investigated in §§ 9.4, 10.2. 


9.3. The conditional estimates of the reliability function 


In this section we touch upon the questions of obtaining TTF estimates which depend on 
unknown parameters @ = (0), 82) of the distribution of additive error. Later these estimates 
will be called conditional, i-e.. known, if the parameters are given. AC first we introduce 
and substantiate two calculation cases for the probability distribution of the error €, and 
thereafter for each case we will write the corresponding TTE estimates of the form (9.11) 
and (9.12). 


9.3.1 Calculation case of a generalized exponential error 


This case is given by a p.d.f. f-(€: 0) of the form: 


exp = pea faa 0, 

fe(EsO1,6.)= 4 | e (9.13) 
sess = > < 
6, 0, exp @) €2>0 (Gis Ge 0). 


The choice of the density (9.13) as a probability characteristic of the error € is prompted 


by the tollowing reasons. The p.d.f. (9.13) corresponds to a situation when a theoretical 
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working capacity model may induce either decreasing or increasing of the working capacity 
of the system. We assume also that our theoretical model doesn’t have a systematic error. 
Due to this circumstance, we choose as f¢(€) a p.d.f. which has a mode at the point € = 0. 
The p.d.f. (9.13) in a general case is not symmetric which enables us, with the help of 
the parameters 6, and 6, to characterize the corresponding significance of negative and 
positive errors of the model. The p.d.f. (9.13) has a form depicted in Fig. 9.1, a. 

Partial cases of the p.d.f. (9.13) describe unilateral estimates (see Fig. 9.1, b, c). That is, for 
the partial case of a negative additive error 6 = 0, the p.d.f. f-(€) becomes one-parametric 


and takes on the form 


1 E 
Pear) eae ae aa (ja oe (9.14) 
0, €>0 (@=8, <0). 
The probability distribution (9.14) should be used only in the case when it is a priori known 
that a theoretical model overstates the real functional capability of the system. The expo- 
nential nature of the p.d.f. of € conveys that the functional form of the theoretical model 
approximates well the real properties of the system, since the probability of the error € 
being in the domain of small, in magnitude, values are greater than in the domain of greater 
values. For the opposite case, when it is known a priori that the theoretical working capac- 


ity model understates the real functional capability of the system, the p.d.f. f¢(€) has the 


form 
; Eta), 
£;0)= (9.15) 
JN 5o(-5); €>0 (0=6 >0) 
9.3.2. Calculation of the Gaussian error 
This calculation is determined by the p.d.f. fe(€) of the form 
1 SP) 
S22), Os) = = O40 || ——S See |e (9.16) 
fe( & 9) J2nO- p ( 202 


The use of this calculation case is substantiated under the conditions of a great number 
of unaccounted factors of a theoretical model which act by the additive scheme. In this 
situation we apply the central limit theorem leading to the normal probability distribution 
of the error. The p.d.f. (9.16) assumes the existence of a systematic error £9. If there is no 


such error, we set €&) = 0 in (9.16), which guarantees that the error € possesses a Gaussian 


property of symmetry. 
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Fig. 9.1 Probability Density Function of the Generalized Exponential Error. 


9.3.3. Conditional TTF estimates for a fixed time 


Starting from assumptions (3) and (4), we suppose that the p.d.f. of the status probabil- 
ity variable Z and additive error of the model € are given, 1.¢., the forms of the densities 
F(z; K-) and f,(€;@) are given, where the vector @ is unknown, and parameters contained 
in the set K- may be found because of the assumptions (1) and (2). The problem of approx- 
imate determination of K, is considered below in Subsection 9.3.4. 

Assuming that the state variable Z and error € are independent. the sought-after probability, 


Ro, in the general case will be written with the help of the integral 
nee eeSe= im (2: K.) fe(€:0)dzde. (9.17) 


Below we will consider the case of the Gaussian distribution of the status variable Z. in 
accordance with which the set k- consists of a mean value mz — E Z| and standard deviation 
On = C4 = niz)"| sila Since, under the assumption, v7 and O7 are known, later we will 
emphasize the dependence of a TTF only on @. Suppose at first that the error € appears to 


be a generalized exponential. Let us rewrite the integral (9.17) in the form 


Ro= ff fl filz) fele)dz ae+ ff f.(2)fele)dzde, (9.18) 


where @; = {0 <z< 0, -z<€ <0} and a = {(0<z2<~,0<&<0<~0U(-w<7<0, 
z2<€<0o))}. After the substitution of (9.13) into (9.18) and integration for the Gaussian 
density f,(z) we finally have 


Ro = (01,65) = (2) + AR (6, 02) + AR2(0;, 82), (9.19) 
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where 
4) 4% 2 
MZ mz (oy 
ARG), 0)) = | SE | cy (H+ = 0, 9.20 
O02) = eae Oz PO 20? = 
and 
& 4% 2 
mz mz 0. 
ARS(6;, 6) = ee (ile oe as) 9.21 


Let us investigate the obtained expression (9.19). First, as @; = 0, we have AR, = 0, and 
the expression (9.19) corresponds to the case of a positive additive error. Analogously, as 
6 = 0, we obtain AR? = 0, and (9.19) characterizes the case of a negative additive error. 
Second, using the limit passing, we found that, as |9;| —> c and for all 62, AR; — ®(mzoz) 
and AR» — 0, i.e., in this case Ro = 0, and infinite negative error leads to a zero TTF value. 
Analogously, as 62 — oo and for all 6;, we get AR; = 0 and AR — ®(mzoz), whence Ro = 
1, i.e., infinite positive error leads to absolute reliability. Drawn conclusions can be easily 
interpreted in the range of the considered model. Moreover, they convince us that 6; and @ 
in (9.19) play the role of significance characteristics corresponding to negative and positive 
errors. This, however, doesn’t mean that for |6,| = |@2| we will obtain Ro = ®(mzoz). The 
cause is that the fact of having a random additive error leads to an increasing of the variance 
of a status variable, i.e., Ow > Oz, whence follows Ro < ®(mzoz). 

For the calculation of the Gaussian additive error, it is easy to obtain an expression for 
the conditional TTF estimate, since in the case of the normal probability distribution of Z 
and €, a generalized status variable W also has the Gaussian p.d.f. with the parameters 
my = mz + €p and Oy = oF aE G.. Consequently, the resulting expression for Ro may be 


written as follows: 


mz + & 


ie 
05 +0; 


For many theoretical working capacity models, we may a priori assume that there is no 


R= 0), (9.22) 
systematic error. Then 


MZ 


\/ 02 + 02 


It follows from (9.23), even in the case of symmetric error € an approximate reliability 


Ro =® (9.23) 


estimate is less than the theoretical one. They coincide only in the case d¢ = 0. 
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9.3.4 The problem of determining mz and 67 


The solution of this problem is guaranteed by the assumptions (1) and (2). In the general 
case the function @(-) is nonlinear, which impedes obtaining exact values of numerical 
characteristics of the status variable Z. A regular approximate solution may be found with 
the help of an approximate representation of the function.@(-). One of the possible ways 
is based on the following procedure. To determine mz = E{@(X)], we approximate the 
function @(X) by the use of Taylor series. If one restricts himself to the smallest second- 


order term, then an approximate formula for mz ts ee written as 


mz = ; LE es a anon (9.24) 
2 1 Sicjen 
where 
my = (my, Mee mn), m; = E|X;] 
oe E(x? m?| 
and 


infe E[X;X;| — mim; | 
0; 0; 

These quantities, under the assumption, form a priori information. To determine G5 we 

replace a function (@(X) — mz)? by a segment of the Taylor series. If one restricts himself 

to the smallest of the second order terms, inclusively, the expression for the variance of the 

status variable is written as 

2 dg a 2 o¢ 
oz = (9 (mx) — mz] + 2 aN Ee om TG Ceti) 02)" pe PU 

(9.25) 

The detailed examination of the question of obtaining numerical characteristics of the state 

variable with the help of different approximations of the working capacity function is given 

is). 


9.3.5 Conditional TTF estimates for variable time 


Consider the problem of determining a TTE. R;. of the form (9.12), assuming that the 
status variable Z(f) is a stationary random process, and W(r) lies out of the zero level 
are rare events, Le., the reliability of a system is high enough. Many practical situations, 
when a system is being subjected for a short time to random stationary loadings under the 
nonchangeable value of carrying capability, lead to this problem. 

The problem of determination of the conditional TTF estimate, R; = R-(@), in a general 


case may be solved by the following scheme. At first we fix the value of an additive model 
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error €, i.€., itis assumed to be nonrandom, and find the probability of r;(€) not being out 
of the level (—€), that is, 

r-(€) = P{Z(t) > —e, O<t < Tt}. (9.26) 
For determination of r;(€) we will use the method based on an approximate determination 
of the probability of the nonfrequent exceeding observations of the stationary process Z(r) 
out of the level (—e€) with the help of the mean number of rejected observations per unit 
time v(€) [26]. If one denotes by gi (€) the probability of k intersections to the one side 
(i.e., whether with a positive or negative derivative) of the level (—€), then the probability 


of at least one exceeding (rejected) point is written as: 
(ik 
ae(2) = Yar’ (€). (9.27) 
k=1 


The mean number of exceeding observations per time tT may be represented as a mean 


value of a discrete random variable of the number of exceeding observations: 

N,(e) = ka) (e). (9.28) 
The assumption about a nonfrequent aie observation of the process Z(t) is equivalent 
to the assumption that the probability of two or more exceeding observations is negligibly 
small in comparison to the probability of one exceeding observation. Whence, neglecting 
in formulas (9.27) and (9.28) all terms beginning with the second one, we will have g-(€) = 
gy) (€) and N,(€) = {!(€) or gz(€) =Nz(€). Thereafter, for the probability (9.26) we will 
write 

re(€) = 1 —gr(€) = 1 —Ne(€). 
Since the stochastic process Z(t) is stationary, the mean number of exceeding observations 
per unit of time v(€) is independent of the current time, i.e., N;(€) = tv(€). Because of 
this fact, for the probability r-(€)the following approximate expression holds: 
PAC vie) Tc. (9.29) 

As seen from (9.28), N;(€) > gz(€), whence, r;(€) > 1 — v(€)T, ie., the quantity 1 — v(e)t 
for r;(€) is a lower estimate. This fact emphasizes the practical use of the approximate 
expression (9.29), which is made possible with the help of the conclusions that may be 
added to the “reliability potential”. 
In order to determine the mean number of exceeding observations of the stochastic process 
Z(t) out of the level (—€) per unit of time, we apply the Rise formula [133]. Restricting 
ourselves to a Gauss stationary random process, we will write the expression for v(€): 


aa 2 
v(e) = = exp cee . (9.30) 
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where 
| aK. (tT) 
an dt 


The correlation function of the status variable K-(7) is determined starting from the initial 


az = (931) 


\ TaD 


assumptions (1) and (2), as it was for mz and Gz. Substituting the expression (9.30) into 
(9.29), we will write the resulting expression for the probability of the stochastic process 
Z(t) not being out of the level (—e): 

azt 


rAlaea = exp | 


ae (9.32) 


2 
<O7 
Returning to the initial situation when the additive error is assumed to be random. we 


determine the desired conditional TTF estimate. R;(@), having evaluated the mean value. 


rz(€) over the set of possible values of the variable € € E: 


R-(8) = [ r-(€) fe(€; 0)de 


or, more explicitly, 
Rey = (ee €:6) exp | - | a (9.33) 


The case of a generalized error € is reduced to the substitution of the p.d.f. (9.13) into the 


integral of the expression (9.33), which leads to the following expression: 


azt | 0 € (€+mz)*] 
R,(6,.@) = 1 -— — x en Y 
as lane [| ® 202 | 


1 = € (€+mz)* 
. an Se des , 9.3 
aah la ae |4e} 88 


With the help of direct calculations, we can verify the validity of the following expressions: 


0 2 2 ae % 

S E+m = m oO mz 
2 exp | — ( iz) |e Vita esp ( . aL —— |, 
J ve 0; 20; 0 26; O;7 


0 © (ose? iy oR mz + 32 
exp |—_— — —_aliie =e id i—») —_ = ||. 
| e p A 205 | saan = 0s 205 :) O7 


Substituting these integrals into the expression (9.34). we write the resultant formula for 


E,(0;, 2): 
, 07 
2mazTt mz Of ) mz + 
66) = 1 Bee. OL [eee 
Rr( 1 62) = A> 6; st 6, 7 207 ( Gy 


\ (355) 
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Let us investigate (9.35). At first, as @. — 0+, we have 


2 
2 % 
mz (oy mz + 
exp (= 2) 1—® ey — 0, 


whence it follows that TTF estimate for the case of negative additive error of a model, that 


is, 
2h 
V2nazt mz of mz + $2 
R,(8,,0) = 1+ ——— a De : 
7 (61,0) =1+ 8, exp (7 = os (9.36) 
For the positive error we analogously obtain 
2 
V 2Nazt (2 o2 mz + 3 
@:(0,6;) = 1 —- +24) 1-® CMe 9.37) 


Secondly, it is necessary to investigate the area of applicability of the expression (9.36). The 
reason it that it is approximate, and is valid only in the case when exceeding observation of 
the process is a rare event. At the same time, as |0)| increases, this property may be broken. 


We can represent (9.36) in the form 


awe 
azt — 
R, (61,0) = [ 1- a if | — AR;(61), (9.38) 
Zz 
where the expression in the parentheses is the theoretical probability of nonexceeding ob- 
servation under the assumption of zero error, and AR;(@) is a correction caused by the 
existence of the additive error in the working capacity model, 
2 
2 20 m o} mz+ % 
ah) Fool) (“ak 


9.39 
203 0; Oz ( ) 


| 
AR,(9,) = azt | — exp (- 
OZ 


Let us investigate the correction AR;(;). Find the limit of AR;(6)) as 0; — 0°. At first, 
in order to find the limit of the first term y(6)) we apply the L’ Hospital rule: 


lim y(@;)= lim 
@, -0 0, +0 


Comparing the obtained limit value with the first summand of the formula (9.39), we ob- 
serve that AR,(@,;) — Oas 0, 0 This fact can be interpreted in the following way: if a 
mean value of the error tends to zero, then the conditional TTF estimate tends to its theoret- 


ical value R;. At the same time, as 8 — — we have y(0,) — O and R;(6@;) — |. We arrive 
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at the contradiction: the increasing of the absolute value of a mean error in this case must 
imply the decreasing of TTF estimate, which in the limit form takes on zero value. The 
cause of this contradiction is explained by the approximate nature of the formula (9.32). 
which may be used (we bear in mind the assumptions imposed on it) for the calculation of 
large probabilities (R;(0)) > 0.9). 

Let us find the range of the parameter 6, for the possibility of using formulas (9.35) and 
(9.36). Taking into account the fact that for known mz and 67 the absolute value of the 
error € satisfies the condition r;(€) > 0.9, or, using (9.32) 


azt (e+ mz)? 
exp 5 
Oz 207 


| <u. 


Solving this inequality for the case of intersection of the stochastic process Ziri with the 


/ 0.16 
€ > —mz+67,/—-21n = oe 
azt 


The limit value for 0; we find under the condition that the probability that this inequality 


level (—€), we obtain 


holds, coincides in practice with the probability of the certain event, i.e., 


| ro 
——e/%ge —-0.99 > 6, = —“_. 
[ 6,” 1. = tnQiOl 


Finally, the interval of the values 6;, for which the formulas (9.35) and (9.36) may be used. 


—mz + 074/ —2 in °18% 
——__$_——__——_ < 9; < 0. 
In0.01 ww ae 
This condition should be taken into account, when one chooses a prior probability distribu- 


has the form 


tion for @;. The case of a Gaussian additive error is easier. The conditional TTF estimate 
depends in this case on the parameters € and oy (the systematic error and mean square 
value of the error, respectively). For determination of Ry (&.6¢) we will use not the com- 
mon expression (9.33), but a more simple argument. Since Ry(€).d¢) — P{ Z(t) ~€ > 0. 
O<t< Tt}, for the Gaussian distribution of Z(r) and € their sum has also a Gaussian distri- 
bution with the mean value mz + €) and correlation function Ay (tT) — GF + K-(T), where 
K.(t) is the correlation function of the process Z(r). Repeating the scheme applied for 
(9.32) for determining the probability Rr(€).d¢) — P{W(t) > 0.0 <1 < Th. we get 


2: 
Oy T m 
Ree. 0e)=1~ Senn (~Fa 
W 


where 
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It is easy to check that az = aw .Therefore, the resulting expression for R;(€0, Ge) is written 
as 


R,(&,O¢) = 1— 


2. 
Es - aa (9.40) 


————— exp | -—>—_- 
\/ 02 +02 2(07 + 0?) 


9.3.6 The method of determination of the numerical characteristics of mz, sz and 
az 


Here, we use the assumptions (1) and (2). We represent the vector of initial variables 
X as random processes ¢(t) = {€i(r),...,€,(t)} and random variables 6 = {€1,...,¢}, 
K+L=N. Let us restrict ourselves to the case when only loadings acting on the system are 
random processes and physical-mechanical characteristics are independent of time. Analy- 
sis of a great number of working capacity conditions imposed on the carrying constructions 
and mechanical type systems shows that loading factors appear additively in the working 
capacity function as some generalized loading S(t) = a &)(t) +--- + @&(t), where a; are 
nonrandom constants. Moreover, any working capacity function may be represented in the 


form 


(5 (t),6) = Q(S) -S(S(t)), (9.41) 
where Q depends only on physical-mechanical characteristics and geometrical parameters 
of the system, and is called a carrying capability. The theoretical model of the device is 
reduced, in essence, to the establishment of the dependence Q(¢). Let, in accordance with 
the assumption (2), there be given the numerical characteristics for the vector of initial 
variables whose order is restricted by the frames of Linear Correlation Theory. For the 
random vector ¢ we are given the mean values me,, mean square values (standard deviation) 
Og, and correlation matrix Pe = pi j, 1 = hs 7a Lp] )P2. .. VEsrorthevectorrandom 
process €(f) we are given the mean values mz, and the correlation functions (Ke@)). 
i= 1,2,...,K, where Kj;(t) = K;(t). The problem of obtaining mz, Oz and az with the 


help of the mentioned set of initial data can be solved in the form of the following sequence. 


Step 1. We determine a mean value mg and mean square value Oy of a carrying capability 
Q. To this end, we apply formulas (9.24) and (9.25) for @ = Q. 
Step 2. We determine a mean value ms and correlation function Ks(t) of the generalized 
loading S(t): 
K K 
ms = aime, Ks(t) = Ya Ki(t)+2 YY aiajK;;(t) (9.42) 
i=l i=l I<i< j<K 


These formulas are given in [200]. 
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Step 3. Using (9.41) we find a mean value mz = my — ms and correlation function K-(t) 
of the status variable Z(t) = Q — S(t): 


K,(t) = 09 + Ks(t). (9.43) 


The following reasoning gives us the formula (9.43). By the definition of the correla- 


tion function we have 
K,(t) = E[(Z(t) — mz) (Z(t + t) — mz)] = [E(Q° —S°(t)) (Q° —S°(t+7))} 


where Q = Q-— mg and S°(t) = S(t) — ms. Taking into account the independence of 
Q and S(t), we obtain 


K,(t) = E[E°?] + [S°(t)S°(t + t)] = 06 + Ks(t). 
The variance of the stochastic process Z(t), by the definition, equals 
o7 = K,(0) = 06 + Ks(0) = 06 + 0. 


Step 4. Starting from the formula (9.31), we find, in view of (9.43), 


a, = --,/—K"(0) = —L,/—K0) 
t OR : an V il 


this being the final step of the proposed procedure. 


9.4 Bayes estimation of the reliability functions under the lack of experimental 
data 


9.4.1 General procedure of Bayes estimation 


The essence of Bayes estimating in conformity to the given problem is that we assign to the 
unknown parameter @ some additive error € of some prior p.d.f. 4(@) which characterizes 
the degree of uncertainty of the information about a model error. For realization of the 


Bayes procedure of obtaining a TTF estimate we need to have: 


a) A prior probability density of the distribution, h(@), 8 € ©: 
b) A functional relation connecting the parameter vector @ and TTF in the form, R = R(@); 
c) A loss function L(R,R) which, in essence, characterizes the losses which appear because 


of the replacement of the real TTF value by its estimate, R. 


In accordance with the setting of the problem, we are interested in pointwise estimate R* 
and Bayes lower confidence limit Ry of the TTF with a confidence level y. The pointwise 


estimate is determined by minimization of the function of the mean prior risk: 


R = argmin f. 1 (R,R(8)) h(0) 49. (9.44) 
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To obtain E we need to solve the following equation: 


‘s h(0)d0 =. (9.45) 
RY<R(9<1) 


The choice of the loss function L(R,R) will be made in accordance with a rule broadly used 

in Reliability Theory: overstating of the estimated parameter is worse than its understating. 

The following loss function, introduced in [217], may be chosen as an example of this rule 
in the theory of Bayes estimation: 

Hiee6)) 2 i (R-R(0)):. , RRO), 

K, (R—R(@))° +K2(R—R(®))°, if R>R(@). 

The loss function (9.46) is very handy for practical calculations, and possesses several 


(9.46) 


merits. Given relations between the coefficients K; and K2, we can control the degree of 
overestimating or underestimating the real TTF by R. For example, with K} = 0 and K> = 1, 
overstating of the TTF estimate of its real value is excluded. With K2 = 0, the loss function 
(9.46) transforms into a mean square loss function. 


With respect to the choice of the prior p.d.f., 4(@), we must consider three different forms: 


a) Prior distributions based on previous empirical data; 
b) Subjective prior ones based on the designer’s experience; 


c) Prior distributions describing a lack of knowledge about the parameter. 


Clearly, the first form of a prior distribution is more preferable than the others, since it is 
based on real data, characterizing existing information about the parameters of error of a 
theoretical model. However, for a large volume of data about the deviation between the 
real and theoretical working capacity models, a designer modifies the theoretical model 
with the help of different empirical coefficients in order to bring it nearer to the real model. 
After this, the necessity of construction of a prior distribution 4(@) based on these data 
drops out. Unfortunately, this situation so desirable is rare. 

In most cases, a designer possesses a very small amount of data about the working capacity 
model error, i.e., such samples with the help of which obtaining a certain estimate of a 
prior distribution is impossible. However, these data form some of his opinions about a 
working capacity model which he attempts to express quantitatively, in particular, with the 
help of a safety coefficient. Namely, this situation makes possible construction of a prior 
distribution. Let us investigate peculiarities of construction of a prior distribution in the 
following example with a working capacity condition (9.7). For the sake of convenience of 


further arguments, we rewrite it in the dimensionless form 


Tox(X) 7) € 
2c Ga (0. 
( a aa 
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where A = E{T.,(X)] is a nonrandom value of a mean carrying capability. Throughout what 


follows we will assume that the general form of a working capacity condition 
o(X)+e>0 


has a dimensionless nature, and € is the relative error of the theoretical model. 
Suppose that a designer is convinced that a limit value of a safety coefficient equals 7. In 
accordance with (9.8), the corresponding quantile of the relative estimate is €, — (7 -1)/77. 
Representation of an interval of a prior uncertainty for the safety coetficient in the form 
[1,7] corresponds more closely to a given state of information, in other words. a statement 
has a less categorical nature: a safety coefficient takes on some value from an interval. The 
corresponding interval for the quantile €, is Ee = [—(7 ~ 1) n.0.. Now we can use more 
exact information. A designer has to estimate the chances of an error value having one or 
other values from the interval E¢, i.e., he must represent a prior distribution 4! @) in one of 
the three forms given in Fig. 9.2. In the first case, we have a uniform prior distribution: in 
the second one, we prefer to choose such values of the parameter error which are near the 
limit one, in the third case, we choose values near to the mean. Let us emphasize again that 
construction of a prior density in the general case is followed by nonformal representations 
by the designer. 
In the considered situation 7 > 1, which corresponds to a negative additive error €. a dis- 
tribution density (9.14) with the parameter 6), having a natural mean error. has been used. 
Now we can easily pass trom /(€,) to A(,), taking into account a linear dependence be- 
tween these characteristics: 
Bie K&pe. 
in which the coefficient k is determined by the condition 
: I 
fe (€; 0, dé = p> k = -———_.. 
—Ep In(1 — p) 
In particular, if 7 = 1, 2, and in accordance with it a unitorm distribution for €,, the interval 
Ee | 0.01667:0] is chosen, then for p — 0.99, 6) is distributed uniformly in the inter- 
val Eg — | 0.0362:0], i.e.. the limit value of a mean relative negative model error equals 
3.62%. 
A designer who has no information about the characteristic of error may carry out some 
tests for the construction of a prior distribution during which values of errors €;. €..... Si, 
are fixed. Even fora small m, it is possible to find a non biased estimate of a mean error 6} 


and choose it as a base value for the construction of a prior density 4(6,). We may choose 
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as interval E, a confidence interval for 6; and determine on it a uniform prior distribution. 
Note that with such an approach a choice of a prior distribution is formalized and a designer 


may not approve a strict decision. 


h(Ep) h(Ep) h(Ep) 


Fig. 9.2 Prior Probability Density of the Quartiles of the Additive Error. 


In conclusion of this question, we investigate a possibility of using nonformal (or improper) 
prior distributions, characterizing a complete lack of knowledge about an error value. For 


a noninformative prior density the following relation holds [114]: 


[mo)ae = 


Investigate a possibility of obtaining a meaningful conclusion about a TTF for the case of 
a Gaussian additive error with a zero systematic component, when we have only Oo, as a 
parameter and conditional TTF estimate has the form (9.23). In accordance with Jeffrey’s’ 
approach [114], an absolute lack of information about O¢ is determined by the p.d.f. 


] 
It\ Cores 0< 6; < 00, 
os 


The use of a mean square error loss function in this case gives us the following Bayes TTF 
estimate: 
ip 6 mz d0¢ 
0 VO7+0 J O¢ 
= 4lORs . 
0 O¢ 


Analysis of this expression shows that the quantity R” is reduced to the indeterminate form 
co/oo, Consequently, the use of noninformative prior distributions gives us an undetermined 
inference about the TTF. The conclusion does not mean, however, that improper prior dis- 


tributions cannot be used for obtaining a meaningful conclusion about the reliability in the 


presence of experimental data. 
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9.4.2 TTF estimates for a fixed time 


Consideration of this question will be carried out separately for the generalized exponential 
and Gaussian errors of the working capacity model. 

Suppose that the error € obeys the distribution with density (9.13) and given prior distribu- 
tion densities h, (@)), 6: € ©; = (0). 67’] C ( ee. 0}, and h2( 2). 2 < O2 = 65. OY = 0.08): 
it is assumed that 9; and @ are a priori independent. In accordance with a common expres- 


sion (9.44) for the quadratic loss function, we will have 


R= ff oq, Ro(O1,62)hi (81 )ho( G2) 40 40>. (9.47) 
1Xx©2 
Denote by 
2 2 
v= nx) = aw (mz %) and v= v(x) = Lae OZ: (9.48) 
OZ x x Ie 
and rewrite integral (9.47) in the form 
* mz v(0;) 
R= 0( )+[f 6; B(u) (0; je U; (0; )hy (0; )d 0, 
Oz e; 
+ [ O, (1 — B(u(G2))] ec") U2(@2)ho(O)dO, (9.49) 
where 
h2(®) hy(9;) 
U;(0 =| d® and U> al dO, . 9.50) 
ia Ce: > =a 


Formula (9.49) is used in the calculating algorithm. The tunetions ( (6) ) and U>(@2) may 
be easily written with the help of analytical expressions for any prior densities considered 


earlier. In particular, for the uniform h; (0; ) and h2(@2) we get 


64 —@ 
U\(6;) =In2—— 30, 6, €), (9.51) 
0, — 6, 
and 
& — 0 
Ua(G2) = Ing ou >, 0 €@p, (9.52) 


the functions U; (6) and U>(6>) vanish, if correspondingly. 42(@2) and / (6) degenerate. 
It gives us a zero value of the corresponding term in (9.49). 
A procedure of evaluating Ro for the loss function (9.46) is more complicated, and may be 


reduced to the following problem: 


R* = argmin if i F (0), 0):R) d0 d0p, (9.53) 
R ©; xO, 
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where 
Ki (x — Ro(1,62))” Ai (61 )h2(®), x < Ro(O1, 62), 
F(0;,@;x) = ¢ [Ky (x—Ro(01,))° (9.54) 
+-Kp (x — Ro(61, 62)) |i (01 )h2(@2), x > Ro(, ®), 
and Ro( 6), @2) is determined by the relation (9.19). We cannot get rid of the double inte- 
gration in this case. The integration procedure is simplified by the fact that the integration 
domain ©; x ©» is a rectangle whose sides are not large. 
For evaluating R5,, we don’t use the common equation (9.45), since in the given case it gives 
us a very complicated calculating procedure. Let us apply the following simple arguments. 


Find values and 0) € @», such that 
P{Gi= 8,6) > 05) = ols 1 (81)hx8,40,d0) = 7 (9.55) 
where ¥ is a confidence probability. Since Ro(@;, 62) in view of (9.19) is a monotonically 
increasing function of both arguments, we get 
P{Ro(81, 8) > Ro (8;,85)} = P{O > 8), & > A}. 


Thus, if the values of @;. 6) are given, the lower Bayes confidence limit Rj, may be deter- 


mined as 
Roy = Ro (9;, 85). (9.56) 
condition (9.55) does not give us a possibility of finding the values 6, and @5. Let us assign 


an equal positive probability sabe the events {@, > 81} and {@) > 05}: 


ie hy (01)d0) = ih hz(@>)d®. (9.57) 
Having considered (9. and (9.57) mutually, we une 
hy (61)a0, = 7", ie hp (8»)d8) = 7", (9.58) 
6, i) 


Finally, we obtain @, and @, are quantiles of the probability | — y'/? of prior distributions 
with densities h;(@)) and h2(@)) we have the following simple formula for 6, and 6): 
OpiOf ay"? (Of =00,) demo, 2. (9.59) 
Thus, the procedure for obtaining Roy is reduced to the calculation of the function (9.19) 
for the values @, and @,, determined by the relations (9.58), or in the particular case, by 
(9159). 
For the case of a Gaussian model error €, all the arguments used above remain valid. We 
need only to put 6, = € and 6) = Og, and instead of Ro( 6, 82) one should use Ro (€0, ¢ ), 
determined by the formula (9.22). In all further reasoning, we have a similar picture. There- 


fore, we restrict ourselves only to the consideration of the first model of additive error €. 
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9.4.3. TTF estimates during the time t 


Here all assumptions with respect to a prior density A(@;.@2) = hy (@;)h2(@2). 0) © Oy. 
@ € @2 remain in force. The expression for the pointwise TTF estimate Rj will be written 
in accordance with a common approach (9.44) for the conditional TTF estimate of the form 
(9.35). Under the assumption of a mean square error loss function, we have. 
Ry = 1- V2nazt If fe (u(@,))e") + [1 - (u( 6,)))} ET didn (9.60) 
@) xO 
The use of the functions U;(@;) and U(@>), introduced by the expression (9.50), lets us 


write Ry with the help of a one-dimensional integral 


RY =1—V2nazt { [ (u(8) oe) hy (8; )U (01) dO 


+f, Pu(o,))e"m(G\U2(G)deb. 61 
7) 
Taking into account the smallness of the domains ©; and ©> we can obtain an approximate 
formula. To this end, we use the following approximation: 
1 ) 
F (81, 82) = ae {P(u( 1) e+ [1 ~(u(G))] e"} 
1 
= F (040, 820) + Fo, (P10. 820) (1 — O10) + F (810. 820) + Fo, (O10. 829) (82 Or). 


where 60 is a prior mean value of the parameter 6;. With the help of it we will write 


V2mazt : ; ee, 
BAS {&(u(6)))e" +f — © (10(649))} 2" } | (9.62) 
829 — O10 


We may conclude, taking into account the form of the expression (9.62), that the obtained 


Re 1- 


approximate estimate depends on prior mean values 6,9 and 629 of the parameters 6, and 
8, respectively. Formula (9.62), as well as a pointwise expression (9.61). has a correct 
interpretation: |@)9| T— Ry |, 09 tT Ry fe 


For the loss function of the form (9.46), the procedure of estimation of a TTF will be more 


complicated: 
Ry = arg min Y. Y (01, @2;R) d0\d@, 
©; xO 
where 
Ki [y — Re(81, 82)]” hi (1 )h (62), y <Rr(8, 62), 


¥ (81, 00;y) = ¢ [Ki (y—Re(61, 62)” 
+K (y — Rr(8, 82))] hi (81 )h2(62),  y > Re(O1, 2). 
For obtaining a lower Bayes confidence TTF limit, we use the approach of 9.4.2. In accor- 
dance with it, 
Rey = Rr (81,95), 
where @, and @, are determined by the expressions (9.58), and for the case of uniform 


prior distributions, by the finite formula (9.59). 
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9.4.4 Bayes TTF estimates considering uncertainty of the initial data 


As follows from the expressions given in 9.4.2, the Bayes TTF estimates for the fixed mo- 
ment of time depend on mz and 67, which are parameters of the distribution of the status 
variable Z, and are determined by the set of numerical characteristics Ky of the vector of 
initial variables X by the formulas (9.24) and (9.25). In practice we often deal with the ini- 
tial data which include the element of uncertainty. In particular, if in the frames of Linear 
Correlation Theory, Ky consists of mean values of the initial variables (characterizing nom- 
inal values), mean squared values (characterizing scatterings) and correlation coefficients 
(characterizing relationships among the variables), then with respect to the last ones we are 
given, as a rule, very approximate values. For example, we may often only as certain that 
a correlation coefficient is positive, and there is no additional information. An analogous 
situation may take place also for the scattering characteristics. Intervals of uncertainty K; 
with prior distributions /(K;) on them may be considered as adequate forms of representa- 
tion of indicated initial data. Moreover, /(K;) are, as a rule, prior densities. If the value of 
some parameter K; is determined uniquely and equals Ks then we choose for it a prior 
probability density in the form of a delta-function hy(Ky) = 6(Ky + ke: the interval K, 
degenerates into a point ae Thus, the form of representation of the set Ky with the help 
of prior distributions is common for the strictly determined and undetermined initial data. 
Below we present a method which takes into account the uncertainty of initial data during 
the estimating of the TTF with respect to the working capacity model with additive error. 

Expressions obtained in 9.4.2 for the Bayes estimate of a TTF depend on mean value mz 
and mean squared value Oz : Ro = Ro(mz, Oz). In turn, by the formulas (9.24) and (9.25) 


we have 
mz = p(Kx) and oz = q(Kx) (9.63) 


We will assume that a prior density 4;(K;) is given for each numerical characteristic K; € Kj. 
In practical situations, for the intervals K; not degenerating into a point, we may assume that 
prior densities h;(K;) are uniform. We will suppose also that K; are mutually independent, 


kes 
h(Kx) =[]Ai(Ki), Kx €K =K, x Kp x---X Kn. (9.64) 
i 


Under the above assumptions, we can formulate the problem of finding the Bayes estimate 
of Rj*, optimal in the sense of minimum of prior risk (the second asterisk appears due to 


the repeated optimality over the domain K), i.e., the problem is to find the estimate of Ra" 
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guaranteeing the minimum of a prior risk 


G (Ro) = [ L (Ro. Rj (p(Kx)4(Kx)) h(Kx)) dR (9.65) 


for the given prior density /(Ky ) and a loss function (. In (9.64) one uses a mean square 


error loss function, then 


Ri’ = [Rb (p(B). 4(Kx)) M(Kx) dK. (9.66) 


Since we have to carry out multiple integrations, the use of (9.66) in practical calculations 
is almost impossible. Simplification may be achieved, if we pass. starting from h! Ky ) and 
transformations of p(Ky ) and q(Ky ). to the prior density for mz and o7.This problem may 
be solved approximately in the following way. 

Due to the small length of the intervals K, (¢ = 1. 2..... m). we represent pr Ay) and qi Ky} 


with the help of linear portions of the Taylor series 
m 
~ 0 (0) (0) 
mz = p(Kx) = p (Ky ) sap (Ky ) (Ki-K} ‘ 
i=] 
and 


m \ 
G2 =4(Kx) =q(Ky) +), (Ky) (Ki-K)). 
il 


nL 


5 z 01 (0° . > 
Thereafter, we find the mean values m, . 67° and variances s;,. 8% of the parameters mz 


me 


and Oz, respectively: 


my) =p(Ky’), 97) =4(Ky’). (9.67) 
and 
= Vol ( KO) cto shee Sake ag, (9.68) 
i=l i=] 
where 


KO = a K;hi(Ki)dK; and og = [xP hi(KiaK; — x)”. 
K, 


Next we approximate the prior densities /,, (a7) and fg (oz) of the parameters mz and 
O7. respectively, by some two-parametric family. Fora large dimension of K-, taking into 
account the statement of a central limit theorem, we may use a normal approximation for 
hm(mz) and lg (Gz). Such an approach enables us to use instead of m-dimensional integral 


(9.66) a two-dimensional integral for obtaining Ro": 


Re = / if Ré(mz, 0z)Mm(mz)hg(Gz)dmzdoz (9.69) 
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Finally, instead of integral (9.69), we can use its estimate obtained after the approximation 
of Ro(mz, Oz) under the integral sign by the portion of the Taylor series up to the second 


order terms, inclusively: 


Ro’ = Ro (m!? é o;) + ans?, a bos?,, 


where 
dane (my’.0!”) O°Rs (my), o!”) 
a= ee! edt yp 
amy? ao” 


9.4.5 A numerical example 


For the numerical example we choose an element important for the working capacity of 
different mechanical and hydraulic transmitters: a spiral cylindrical ring. Assume that a 
central static force T (expanding or contracting) acts on the ring. The cross section of the 


ring works on torsion, where the maximal tangent tension is computed by the formula 
My 
W,’ 


where M, is a torsion moment, W; is a moment of resistance of the ring to a torsion. For 


Tmax = 


M, in [23] is proposed the following formula: 
ae kTD 
2 


in which D is a mean diameter of the ring, k is a coefficient depending on the curvature 


’ 


of the ring loops and form of the cross-section. From this point on we will assume that 
the ring is made of a round wire with the index c = D/d (d is the wire diameter) which is 
greater than 4. In this case, for the correction coefficient we recommend [23] the following 


dependence: 


ee. fe 0.615 
Ae c 
Taking into account the above arguments, we rewrite the working capacity condition in the 


form 
OCT, t,D.d) = tr — Ga (T,d,D) > 0, (9.70) 
where Tr is a fluctuation limit of the material, and Tmax 1s computed by the formula 


8 /4D-—d D 
=m gers cea 
Smax er (Ora ra z) 


As seen from the represented working capacity model, the vector of initial variables X is 


composed of the following random variables: T, tr, D, d. 
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Table 9.1. Numerical Characteristics for the TTF Calculation 


ch ig 


t. H/m* 


0.95.10" Aoallt). = 


0667 10 + 


For the sake of simplicity of calculations, we pass the dimensionless analog of the working 
capacity condition (9.70). To this end, we divide all terms of the inequality (9.70) by the 


number A = E [tr]. This gives the following relation for the status variable: 


za _ Tmax (Td, D) 
A A 
All further calculations will be carried out in accordance with 9.4.1 and 9.4.2. As a ring 
material the steel SOXBA has been chosen. The numerical characteristics tor the TTF 
calculation (the set Ky are given in Table 9.1). With the help of these data and formulas 
(9.24) and (9.25) we obtain p; ; = 0, mz = 1.488-10 ' and oz 0.5109-10 |. If the ring 
TTF is computed by only a theoretical model, the TTF value equals R = 0.9982. 
Let us now find the Bayes estimate taking into account the model error. Suppose we know a 
priori that the additive model error leads us to overstate the carrving capability of the ring. 
This corresponds to the calculation case with a negative additive error. The distribution 
density has the form (9.14) in which the parameter @ has the sense of a mean value of 
the error. Let us find the segment of a prior uncertainty for @. Assuming that under the 
static loading one uses the safety coefficient 7 = 1.3 [23]. we determine the limit value of 
the additive error €, = (1) 1)/n = -0.23. With the help of recommendations given in 
9.4.1, we find the limit value of the mean error (with p = 0.99): 
gps Era 
In(1 — p) 


Taking into account a hypothetical experience, we choose as an interval of a prior uncer- 


On = ~ —0.05. 


tainty Eg = [ -0.05; 0.01) and will assume that 6 has a normal distribution in Eg. This 
distribution corresponds to the situation when a designer supposes that the mean model 
error lies in the limits from —5% to 1%, and cannot give a preference to some value from 
this interval. Having chosen a mean square error loss function, we define a pointwise TTF 
estimate by the formula (9.49) with 0; = @ and @) = (0). This yields R) ~ 0.9778. 

Such an essential decreasing of the TTF estimate in comparison with a theoretical one may 
be explained by the fact that the assumption of a theoretical working capacity model always 


overstates the real carrying capability. In Fig. 9.3 we represent the dependence of a prior 
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Fig.9.3 The Estimate of TTF as Function of the Limiting Value of the Mean Error: Solid (Dashed) Line Without 
(With) Error in the Numerical Characteristics 


TTF estimate on the left limit 6’ of the uncertainty interval for @ as 6” = O and different 
values of a mean of the wire diameter d. As seen from Figure 9.3, while the absolute value 
of 9’ increases, a TTF estimate decreases. At the same time, by increasing the diameter 
of the wire we may ensure the desired TTF value. In the same figure we denote by dotted 
lines TTF estimates which touch upon uncertainty of the initial data. Carrying out the 
calculation, we assume that the mean value of the loading my and its scattering O7 have 
asymmetric 10% uncertainty interval. It may be observed that a TTF estimate decreases 
because of its uncertainty. 
For the values of numerical characteristics of the theoretical status variable mz = 0.1448 
and 67 = 0.05109, one has carried out a lot of numerical calculations of prior TTF estimates 
for different intervals of a prior uncertainty ©, = (6), 8;'] and © = (63, 04’). In Table 9.2 we 
present the results of calculations of TTF estimates Ro and Ro,, corresponding to the case 
| = 6; = 0 for different values 6; and 63’ (values of Ry, are given in the round brackets). 
As can be seen from the table, enlarging of the prior uncertainty interval for the negative 


error implies decreasing of the Bayes TTF estimate. At the same time, enlarging of the 
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Table 9.2 A prior estimate for TTF with 6/’ = 0} = 0. 


~0).04 0.00 


-0.02 


0.9746 0.9904 0.9978 0.9993 
(0.8948) | (0.9555) } (0.9908) | (0.9987) | 
0.9715 0.9889 0.9974 0.9991 
(0.8948) | (0.9544) | (0.9904) | (0.9986) 
0.9670 0.9867 0.9966 0.9988 


(0.9533) 
0.9826 
(0.9526) 


(0.9984) 


(0.9900) 
0.9951 
(0.9867) 


(0.8930) 
0.9599 
(0.8920) 


0.9982 
(0.9982) 


uncertainty interval for the positive error implies enlarging of the Bayes TTF estimate. 
These conclusions agree with a qualitative analysis of the dependence of the TTF on the 


value and sign of the error of the theoretical working capacity model. 


Chapter 10 


Statistical Reliability Analysis Posterior Bayes 
Estimates 


10.1 The likelihood function for independent trials 


This chapter is a continuation of Chapter 9, generalizing the results in the case of a posterior 
estimation when experimental data about the parameters of the tested system are known. 
When we project and build technical devices, it is customary that two types of testing 
are carried out: functional and exploratory ones. The purpose of the researches of the 
first type is to establish factual levels of the functional capability of the system with the 
help of tests in laboratories or on test benches. With the help of the second type of tests, 
one verifies a model’s working capacity under the exploitation conditions or under the 
conditions which are similar to them. In the problem considered below, we unite both such 
results in order to define more exactly the errors of the working capacity model and the 
time to failure probability. The solution of this problem follows the general scheme of the 
Bayes statistical estimation including the definition of a likelihood function, construction 
of a posterior distribution, and the obtaining of a corresponding estimate starting with a 
chosen loss function. At the end of this chapter we shall give some cxamples of using 
the proposed procedures of a Bayes posterior estimation for the solution of some applied 


problems. 


10.1.1. A likelihood function from the results of research tests 


The essence of research tests is that each test is carried out until a failure occurs; as a result, 
we find a real level of an object’s functional capability. If one carries out tests under loading 
which increases constantly, then a loading value causing a failure is chosen as a real value 
of a functional capability. 

Let us return to the example considered in § 9.1. We are reminded that the purpose of 


research tests is to obtain empirical information, which helps us to correct Euler’s for- 


ZI/F] 
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mula (9.3). Suppose that the first element put to testing has an elasticity module £), length 
(,;, and moment of inertia J;. The loading which implies a failure will be denoted by 77’. 
The value 7 is a factual level of a carrying capability for the first test. At the same time, a 
theoretical value of a carrying capability is defined by the formula (9.3) and equals 


WES 
wre; 


Ter\ a 


Clearly, the difference 7)’ — T.-; determines the error of the Euler formula for the first test. If 
we use a relative additive error e and generalized working capacity model of the form (9.5). 
then the fact of the appearance of a failure during the first test is written formally in the 
following way: 

Ter) = 


Se 
A A 


where A = E [Teele and an experimental value of the relative additive error € in the first test 


is determined uniquely by this expression, i.e., €) = —(7,-1 — 7) A. Analogously. we can 
determine the value €; for each research test. 
In a common case for the generalized working capacity model of the form 01 X}—e€ > 0. 


the value of the additive error is determined by the expression 


€; = —$(x;), (10.1) 
where x; is a realization of the vector of initial variables which is fixed in the j-th test. If we 
obtain x; by the scheme of independent tests, and a random variable of the additive error 
€ obeys a probability distribution with a density fe(€:@), then the likelihood function (in 


accordance with [123]) has the form 
¢(@ |e) =|] fF (e;:8). (10.2) 


where € is the set of all values €, (7 1. 2.....7,). Let us write the resulting expressions 
of two calculating cases introduced in § 9.3. 


The case of a generalized exponential error: 


l @ @) 
€:(0,;,@ | €) = -——————- ex -(F+F] 10.3 
Here the statistics @; and @ are computed by the formulas 
ki t, 
a) =) late a Ge 
i=| i=] 
and the sets (€;. €2..... So eamMiGieCs...3% ¢;,) are generated respectively by negative and 


positive elements of the sample €, where kj + €; = nj. 
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Table 10.1 Bayes Estimators for TTF. 


ae Result of j-th Test 
aces, 


Qualitative Information 


Quantitative Information Based on 
the Theoretical Model 


Quantitative Information for the 
Additive Error 


The case of a Gaussian error without a systematic bias: 


1 s? ) 
€;(o- | €) = —————— exp | -——— }, 10.4 
i(e |€) (any 0f p( 202 eae 


where 


10.1.2 A likelihood function from the results of functional tests 


A distinctive peculiarity of functional tests is that they are carried out under conditions 
coinciding with the exploitation conditions or ones similar to them. Because of this cir- 
cumstance, we cannot, as a rule, fix a failure fact. Therefore, during each test only one 
of the following three events may be observed: A is a working capacity of the device, A 
is a failure, Az and is a nonworking state of the device. Note that events A3 and A> do 
not coincide. The failure is observed only when the loading takes on a value equal to a 
functional capability (in this case the generalized status variable W takes on value zero). 
At the same time, a nonworking state corresponds to the situation under which the loading 
is higher than a functional capability; a generalized status variable will be negative in this 
case. 

Assume that in the j-th test some realization of the vector of initial variables x; (j = 
ecw n) is fixed. Each element from x; can be measured in the tests or its value is 
assumed to be equal to the calculating one. It enables us (in accordance with a chosen 
working capacity model) to find the value of Z. For empirical value of a theoretical sta- 
tus variable for each of the three possible outcomes of the test we will denote A; by z; 
(j = 1, 2,...,7), Az by 2% (j = 1, 2,...,d) and Ag by zj (j= 1, 2,...,8). This data gives us 
quantitative information about the value of an additive error € for each test. Suppose that 
during the j-th test a working capacity (event A)) is observed, i.e., a generalized state vari- 


able W; > 0. Since W = Z + €, from the condition W; > 0 we have €; > —z'. A complete 
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description of all test outcomes is given in Table 10.1. The results of the functional tests will 


be represefited inthe ’form @f tHe Set Zr inenteiie 2 e'(s).25.....e,0m Pap.s.. cap. 
and 2” = (z,23,....2). If one considers these tests as experimental findings of the addi- 
tive error €, then the vector Z may be interpreted as censored from the left and right sample 
of a random variable €. When a distribution density f,{€:@) is given. we represent the 


likelihood function for the sample in accordance with [123] in the following way: 


r co d Ss =a 
€@(@ | €z) = I] f f(eovdeT] fe(- 3:6) T] f fev €: 0 ide. 
Hie Ne ee JI Je 


or 
r CO : d , AY 
Ce (@ | €z) =f, [1 —Fe(-26)] []fe( - 25:6) [] Fel s4.@). (10.5) 
bl as, =, =| 


where Fe (€;6) is the cumulative distribution function, corresponding to fe(€: 4). 
A likelihood function for calculating the case of the generalized exponential error. The 
expression for the p.d.f. fe(€:@) was written earlier in the form (9.13). Then the corte- 


sponding distribution function may be written in the following way: 


0; E 
genre ar 2 €E<0, 
F,(€;0,,0)) = 2 0, me (10.6) 
: ei al >0 
0, a0; exo ( ry & 


Represent each of the vectors, 2’, <*. 5 as a union of two vectors consisting of negative 


and nonnegative components: 2’ = {€’,C’}. 2° = {G7 Oth. me 4S". OS"). Dimensions 


2 J 
is 5 i . et - 
of components of new vectors we denote respectively by rand r. for &° and £'. d 


i] 


dfid d, for €* Bfid ¢*,.s and sp fr 6” Gnd. Clee Stipe Fe EG EE”) 
has the dimension m_ = r_ + d_ +s _, and the sample € = (¢', €°. £) the dimension 


m4, =r.+d,+s.,. The likelihood function (10.5) transforms to: 


C(O). @> | =) Q(0,.92:d.r hy) PRO nGs: OAR (Oy BH IS (0;.02.£") (10.7) 


= 


(ono, 
O61, O2id, 1-184) = EBT as, - (10.8) 
@ 
P(0;, 82; @),@2) = exp (F+3) (10.9) 


dy $4 d_ a 
m= 15 + BG wom Foe YS. 
ie j=! iE j=) 
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ies i 
Ry (Gi@¢') = T] 1+ oe 6o(5) (10.10) 


3 


and 


S (0 0 é) ll ie $i 10.11 
= 236) = = exp| — ||. A 
1, 9256 u 6, p @ ( ) 
Note one interesting peculiarity of the obtained likelihood function. To this end, we con- 
sider a particular case of a generalized exponential error for which 02 = 0, thus e < 0. The 


distribution function (10.6) in this case has the form 


€ 
exp{—-—]}, €<0, 
P(e; 0),0) = P( | (10.12) 
il, é€> 0. 


If the assumption € < 0 is true, then the values zj and zj observed during the test must be 
always nonnegative. Since W = Z+ € and W > 0, as € < 0, we obtain zi > 0. Analogously, 
as W = 0 and € < 0, we obtain z; 2 0. For the nonworking state (W = 0) the values 
zj may be either negative or positive. But for the negative values a in accordance with 
(10.12), we have, Fe (2); 61,0) = 1, ie., negative values zi for the likelihood function 
will not be noninformative. The conclusion we have made has an evident explanation. 
If € < 0, ie., a theoretical model overstates the real functional capability, then for Z < 0 
always W <0). Thus, even if we don’t carry out tests, we can write the great number of 
negative values zj and ascertain that for all these values in the tests the nonworking states 
of the system will be realized. In other words, without tests we would find their outcomes 
and use them in the likelihood function. However, this has not occurred, since under the 
condition Fe(—z//;6),0) = 1 for all zj <0, the likelihood function doesn’t react on the 
negative values z. This wonderful property of the considered Bayes procedure emphasizes 
its validity. 

A likelihood function for the Gaussian error without a systematic bias. Here we assume 
that a theoretical status variable may take on positive or negative values. The resulting 


expression for the likelihood function has the form 


H(z). (10.13) 
O¢ 


l 1 w*2 Ss 
tool) = aan Go (-$5) I 


where w*? = Bey a 
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10.2 The posterior distribution of the error parameters of a theoretical 
working capacity model 


In the general case the posterior distribution of the vector @ is determined with the help 
of the Bayes theorem. In this section we investigate in detail different questions in ob- 
taining the interesting posterior distributions from a practical point-of-view. We consider 
separately densities h;(@ | £) and he (6 | z) which characterize, respectively. research and 
theoretical tests, and also the density of the distribution fi(6 | €,Z) corresponding to the set 
of tests of both types. In addition to this, we investigate the possibility of using improper 
prior Jeffrey’s distributions. The discrete form of representation of prior and posterior dis- 


tributions will be considered separately. 
A posterior distribution of the parameters of error € for research tests. In accordance 
with the Bayes theorem, 

hi(@ | €) ~ h;(@)é;(0 | €). (10.14) 


For calculating case of a generalized exponential error € with a likelihood function (10.3). 


a posterior density in accordance with (10.14) is written in the following way: 


1 hy (1) h2 (62) | (F =) | 
AO), G3 |) = — ex eee res) 
( 1 » | €) B; (@—0)" p 01 a 1 I nt 
where the normalizing factor B; is determined by the integral 
hy (81 )ho(@) (3 al 
= ——_{_ exp |-— | — + — } | dO) dh. 10.16 
B (6) — 1)” Pp 6; 0 1 ( ) 


For evaluation of (10.18), we need to apply numerical methods even in the case of uniform 
prior h; (@)) and h (6). 

Consider a possibility of using improper prior / (4) ) and fio (62) for obtaining h, (0). 02 , 
€)) Taking into account Jeffrey's theory [114], we conclude the following prior densities 


correspond to the absence of information about the parameters 6; and @): 


hi(81)~ a 81 €(—~,0], A2(&)~ 5, 2 € 0,5). (10.17) 


& 


Substituting (10.17) into (10.15), we get 


1 @, @ 
(602) ———— xp || 
(6), 62 | €) TCC eh abel (F+3)] 
—0 <0, <0, 0<&<o. (10.18) 


It is easy to verify that 


I i @ 
val : + dO) d0 < 
B ja 0; 82 (@> — 8) -exp] (3 =| ° 
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Consequently, in spite of the fact that prior distribution densities are improper, the posterior 
density (10.18) is proper and may be used as a basis for obtaining the conclusion about a 
TTF and error value. 


For calculating the case of a Gaussian non biased additive error, the posterior density has 


the form 
1 h(6¢) s2 
hi (oe | €) “hoc (-5). O¢ € Eg C (0,0), (10.19) 
where 
h(o¢) s 
B; = von SP (-) al Ge. 
The use of improper prior density h(6¢) ~ 0, | leads to the proper posterior density for 
which 
hi(o, i- —e _ O¢ € [0, 00) (10.20) 
t (2 =, of I p 202 . ‘3 ry . . 


As seen trom the relations obtained above, posterior densities of the parameters of the ad- 
ditive error of the working capacity model have the same structure, besides, for evaluation 


of the normalizing factor we need to use methods of numerical integration. 


10.2.1 The posterior distribution of the parameters of the error € for functional 
tests 

If the prior density h(@) is given and the likelihood function ¢g(@ | €z) is known, for the 
posterior density, corresponding to the results of functional tests, we write, applying the 
Bayes theorem, we write, applying the Bayes theorem, 

hey (0 | €z) ~h(@)lp(@| ez), OEO. (10.21) 
All further arguments connected with obtaining concrete expressions for the posterior 
density are based on item-by-item examination of all possible combinations of h(@) and 
€(@ | Z) in the right hand part of the expression (10.21). In particular, for calculating the 


case of the generalized exponential error with a likelihood function (10.11), we will have 


he (01, @2 | Z) ~hy (0) ho (O2)O(@), 3d, r_,54) P(O1, Or; , 2) 


hel )S_(0),056 je Oe Ol, GeO. (10.22) 
Moreover, for the improper prior density h(0,, 02) ~ —9, ips ' this expression is changed 
to 


he (01, 02 | z) ~— 60, '0,'O(01, 3d, r_,s,) P(O1, 0; @, 2) 


x Ry. (01, 2; §°S_ (1, 0235"), 6, € (—~,0], 62 €[0,-). (10.23) 
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We shall investigate the possibility of using (10.23) in practical calculations. The posterior 


density (10.23) is proper, if 


i 
—— d&de co, 10.24 
[| 50 (91-02 | €2)d02d0, < (10.24) 


Analyzing expressions (10.8)-(10.1 1) we conclude that condition (10.24) 1s fulfilled if and 
only if at least one of the numbers d. r,s. doesn’t equal zero. Under the condition 
d=r =s, =0, itis impossible to use the posterior density (10.23) 1n order to obtain an 
informative conclusion about a TTF. For calculating the case of the Gaussian error €. we 


have 


2 


h{o, 
he (Ge |=) ~ Cex (- 


w*? 
. 
Ee Og 


a eX) eae 
Apes) He (s) 


For the improper prior h( oe) “Op 1 O< o¢ < &, relation (10.25) takes the form 


1 wo” q zj i zj 
he(or|2) ~ -ren(- 25) TT] 1-@ Oo fds a : (ORG) 
P 


> 
NOTE ff Tl 


10.2.2 The posterior distribution of the parameters of the error € by the set of 
results of research and functional tests 

If a researcher has a possibility of carrying out research tests for the construction of the 

posterior density characterizing the form of information after the termination of the last 

test, one can use a consecutive Bayes procedure. The essence of this procedure is: at 

the first stage, including research tests, in full accordance with recommendations given in 


10.2.1, we determine a posterior density of the distribution 
hi(@ |e) ~h(0)6;(8 |e). (10.27) 


If functional tests are carried out after the research tests, for the determination fig (@ =) it 
is more reasonable to use not h(@) but h;(@ | €). 
Then 


he(O |z) ~h;(O | €)l (0 | 2). (10.28) 


~ 


The posterior density hg (@ | a) should be interpreted as resulting for a whole two-stage 
sequence of tests. We will take into account this fact. denoting by h(@ , €.) the resulting 


posterior density of the parameter 6. 
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Substituting (10.27) into (10.28) we write the final expression 
h(O | €,z) ~h(0)0;(@ | €)lp(0 | z). (10.29) 


We will call the product ¢(@ | €,z) = ¢;(0 | €)€@(6 | z) a cumulative likelihood function. 
Using (10.2) and (10.5) for €(@ | €, z) we obtain 


e(8 | €,z) (10.30) 


= [Yl A(=25:0)] [Le( <9) FL e(e8) ITs 


0€®@. (10.31) 


Having remembered expression (10.1) for the element of the sample of research tests we 
havecn=—" = Roadie « nj. Table 10.1 shows z; = —(x;). Therefore, €; and =; 
have the same values of the theoretical status variable Z at the failure moment appear- 
ance, i.e., when the acting loading becomes equal to a functional capability. Taking into 
account this circumstance, we may draw the important practical conclusion: if the results 
of research tests are put together with the results of functional tests in which the failure 
has occurred, then a cumulative likelihood function ¢(@ | £,2) coincides with the func- 
tional ¢@(@ | z). This conclusion lets us use the results of 10.2.2 for the determination 
of the posterior density f(@ | €,2). To this end, one should include in the sample z* the 
elements of the sample € taken with the opposite sign. That is why later we will assume 
v= reeee | ee —£;,). We can also use a similar method in the case when 
under the research tests it is assumed, for some reason, that non attainment of a limit state 
takes place. 

In conclusion, we note that the posterior distribution density is an exhaustive characteristic 
of the working capacity model error. However, due to the practices existing now, to make 
a conclusion about the properties of the device with the help of numerical criteria, it is not 
sufficient for estimating the TTF of the system and the value of the error of the theoretical 
working capacity model to have knowledge of a posterior density. In 10.3 we will find cor- 
responding numerical estimates with the help of the posterior densities obtained above. The 
more visual method of analysis of the system properties may be obtained from a discrete 


representation of prior distribution considered below. 


286 Bayesian Theory and Methods with Applications 


10.2.3. The discrete posterior TTF distribution 


Using discrete prior distributions of the parameters of the error €. we will find correspond- 
ing posterior distributions of the TTE. Let us restrict ourselves to the case of the generalized 
exponential error €, obeying the probability distribution with the density (9.13). Suppose 
6, and @) have prior distributions respectively, {pee ). p=e|. 2)... said 1 papG ae. 
k=1,2,...,8, where pj; = P{0; = 6);}, px, =P1 = @,}. Withithiemielp of tigserdis- 
tributions and the relation (9.19) we can find a prior distribution for the TTF (Px,.R,). 
J = li2dy.ccamk, Where; = R(01;. O14), Pri © Pu.Pie. The correspondence between the 
index j and a pair of indices (i,k) is given by the elation R, ; ~ R,.i.c.. in order to write the 
distribution series for all the TTF R we have to carry out calculations of R,, = R!@),. Os, 3 
for all possible pairs (7,k), and write the obtained values in ascending order. and renumber 
them from | to mk. Thereafter. each value R; is associated with the corresponding proba- 
bility p1; P2,. Here and further on we shall assume that among the values of AR, there are no 
repeated values. , 

Using the likelihood function (10.11) and applying the Bayes theorem. wetind in the dis- 


crete representation the posterior probabilities py; = P{R = Rj | z}: 


Pr; ba (1;, 02, 2x | 2) 
lle Pen: mk, (10.32) 


m 
X 2, Pe PuiPrrbe (Ari, 921, O2x | Z) 


where the correspondence between j/ and a pair of indices (7. k) is found with the help 
of the already mentioned procedure. The distribution series (pg, R,). j = bo 2..... mk is 
an exhaustive characteristic of the TTF and is more visual in comparison to a continuous 
posterior density. Besides, itis free of known arbitrariness and is connected with the choice 
of a loss function. 

A numerical example. The automatic control system ts described by the differential equation 


ST +H=(A+1), ¥(0)=0 (10.33) 


where A is a random variable obeying the normal distribution with the mean value O and 
variance ().01. The system is assumed to survive, if at the moment = | the variable Y is 
greater than the value yo = 0.42. 

The theoretical model of the system (10.33) consists of an additive error €, which can be 
described by the generalized exponential distribution (9.13), where. the parameters 6, and 
8 belong to the intervals @; = [0.08;0], ©2 = [0;0.06}. The prior distributions for 6; and 
6) are given in Fig. 10.1 and Fig. 10.2 by the dotted lines. As a TTF of the system the 
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probability R = P{Z + € > 0} has been chosen, where Z = Y(1) — yo. Using the interpola- 
tion method [42}, we obtain E[Y(1)] = 0.7622, D[Y(1)] = 0.01381, whence mz = 0.3422, 
@7— 0.1175. 

The following values of the theoretical status variable have been fixed during the 
seven tests 2° = (0.2663; 0.4309; 0.3567; 0.5783; 0.2619; 0.3385; 0.4851), z*=9, 2” =9. 
Figs. 10.1—-10.2 represent the posterior distributions of the parameters of the error 6, and 
6, and TTF R. As seen from the figures, the experiment results correctly identify the prior 


distributions (they are represented by the dotted lines). 


Pri 
0,8 


-0,08 0,06 aes 


Fig. 10.1 Probability Distributions of the Parameters @; and 6). 


10.3 Bayes posterior estimates 


The procedure of the posterior TTF estimation coincides with the procedure of a prior 
Bayes estimation given in § 9.4. The difference is that instead of the prior density A(@) we 
must use the posterior one, (6 | z) obtained by the results of a joint experiment, including 
research and functional tests. In this chapter we adhere to the following scheme. At first, 
we consider obtaining the estimates of the parametric additive error €, and thereafter we 


find the corresponding TTF estimates. 
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Fig. 10.2 Probability Distribution of TTF. 


10.3.1. The posterior estimates of the error of the theoretical working capacity 
model 


The problem is to Bud the posterior estimate of the mean error € = EF, of the theoretical 
working capacity model for the case of a generalized exponential error and an estimate of 
O- for the Gaussian error without a bias. 

Calculating the case of a generalized exponential error, Obtain the dependence &) = 
&9 (6), 62). With the help of (9.13) we easily find 


& = Ele] =H € fe (€; 0,, de = 0; + O. (10.34) 


Because of the linear dependence (10.34) we find first the estimates of the parameters 6, 
and @/ in the form @; and, an thereafter, summing them, we determine the estimate. The 
estimates 6; and 6; will be determined as corresponding posterior mean values by the 


formulas 


a; = {ff 9, 018 (81, 02 | £2)4,d6, (10.35) 
D1 XO 


and 


a; = fff 6oh( 8), 0> | €2)d0,d0>, (10.36) 
©; xO2 
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Fig. 10.3. Trend of the Operational Capacity during the Experiment. 


where h(O,. > | a is determined by the relation (10.22) under the assumption that the 
sample z contains the results of research and functional tests. Simplification of the inte- 
grals (10.35) and (10.36) does not seem possible, and, in order to carry out practical calcu- 
lations we need to apply methods of numerical integration for the double integrals. There 
is a possibility of determination of exactness of the & = ey ate 63 in the form of posterior 
mean squared value 6g» = {D{e}}!/* with the help of the following formula 

G;. = D[0;] + D[@] + 2K[O;, 6], (10.37) 
where 


5[6;] =f 67h (0), 0 | €z)d0\d® — 67", i=1,2, 
@,; xO» 


K[6;, 0] =i 8, Oh (O, & | €z)d0,d0> — 67 63. 
©; xO 
Calculating the case of a Gaussian error of a working capacity model is reduced to the 
analogous (but one-dimensional) integrals. With the help of these integrals we determine 
the estimate 6 and its error in the form of the posterior variance D[o,|: 


j= i Och( Ge | €z)dGe, (10.38) 
0 
and 


D{o,] = i: Oe h( Ge | €z)d0¢ - 6), (10.39) 
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where h(O¢ | €z) is determined by the relation (10.25) under the assumption that the sample 


€z contains the results of research and functional tests. 


10.3.2 TTF Estimates with fixed parameters 


To obtain TTF estimates in the case of the generalized exponential error €. we will start 
from the conditional TTF estimate R(6;. 62) given by (9.19) for the fixed time moment. 
and by (9.35) for an arbitrary time moment. The posterior density fi(@).62  €z) is deter- 
mined either by expressions (10.22) for the proper prior distributions, or by (10.23) for the 
improper ones. In addition to this, it is assumed that the sample €2 contains the results of 
research and functional tests. 

For the quadratic loss function, we have the following integral which enables us to find the 
TTF estimate R*: 


oa _ 
a‘ Too, ® (01-9) ( 01-02 | €z)d0\d6> (10.40) 


If one uses the loss function of the form (9.46) for obtaining the estimate R*. it yields the 


optimization problem, analogous to (9.53): 


R* =arg min I F (0), @);x)d0)d@). (10.41) 
+E [0.1] JO, xO, 
Where 
Ky [x — R(0;, @)]” (0), ® | 2), x < R(0;.0), 
F (0), 63x) = 


Ki (x—R(O1,05))° + Ko(x—R(61,6)))| h(O,,0)|z), x > R(@,,@). 


The Bayes lower confidence limit R} will be determined analogously to the approach pro- 


posed in 9.4.2 as 
Ry = R(@,, @), (10.42) 


where 6, and @, are found from the transcendental equations 
a 04 ey 
f i h( 0), 0 | €2)d0\d® — y'/? =0, (10.43) 
Je, J64 
and 
6) 8s fe 
[ ‘ h( 0), @> | €2)d0,d0 — y'"/? =O. 
wil 2 


We use a similar calculation approach in the case of Gaussian error. The pointwise estimate 


R* is determined with the help of the one-dimensional integral 


Mt 


R* = in R(O¢)h( Og | €z)doe (10.44) 
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for the quadratic loss function, or with the help of the following minimization problem that 


we have to solve: 


H 


R* = arg min is i F (6¢:x) dog, (10.45) 
x€[0.1] Jot 
where 
K; (x—R(o¢))’ h(o® | z) x <R(oe), 
Fi 6.2%) = (10.46) 


[Ki (x -R(oe))? + Ko (x—R(oe))] A(Ge |z), x > R(oe). 


In the relations (10.44)-(10.46), R(o¢) is determined by the formula (9.23) for the TTF 
at the fixed time moment fo, or by the formula (9.40) for the TTF during the time t. For 
the posterior density h(o¢ | 4) one should use the expression (10.25), assuming that the 
sample Z contains the results of research and functional tests. When the confidence level y 
is given, we obtain the Bayes lower confidence limit of the TTF Ry by the usual approach. 


In accordance with it, 
R* = R(o,). (10.47) 


In order to find o, we need to solve the equation 


it 


| * (Ge | €2)doe — = 0. (10.48) 


Ge. 


10.3.3 Investigation of certainty of the Bayes estimates 


We carry out numerous calculations of TTF estimates for the samples of different volumes 
and a broad range of a priori data with the help of the method proposed above on the basis 
of Example 9.4.5 in order to obtain information about the quality of this method. 

Investigation of posterior Bayes TTF estimates has been carried out with the help of sam- 
ples of values of the theoretical status variable Z which have been modeled by the special 
algorithm. The essence of this follows: for each j-th testing two numbers are generated. 
They obey a normal law with the parameters mz, Oz and €; which follows the probability 
distribution with the density f¢ (e: o ome given by the expression (9.13). The quan- 
tities om and 6° have the meaning of real values of the parameters 6, and @), which are 
determined by the uncertainty intervals ©; and ©2. The chosen values of mz, 6z, oe and 
qe” determine uniquely the real TTF value R. For each j-th random probe we determine 
the value of the error € of settling the generalized status variable @; = z; + €;. Having 
chosen some error value 6 of settling the generalized types of outcomes we find: a working 


capacity, if @; > 6; a failure, if |@;| < 6; a nonworking state, if @; < —6. In accordance 
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Table 10.2 Bayes Estimators for TTF. 


na) i) nee 100 
0.9746 | 0.9755 [ 0.9684 
0.9715 | 0.9710 | 0.9675 
0.9670 0.9693 0.9864 
0.9599 | 0.9672 9.9650 
0.9904 | 0982) oo769 | 
0.9889 | 0.9803 09753 | 
0.9867 | 0.9776 | 09729 
0.9826 | 0.9736 | 0.9695 | 
0.9978 | 0.9950 | 0.99N4 
0.9974 | 0.9944 0.9936 
0.9966 | 0.9936 | 0.9874 


Table 10.3 Postenor Estimators for TTF 
na 20 | ne 40 n 60 a ees 
0.9860 0.9719 0.9787 0 9640 
0.9849 0.9704 ().9780 0 9625 
0.9923 0.9827 0) 9825 Q9772 
0.9912 0.9809 0.9836 W9RS? 


with the type of outcomes of the j-th trial, the corresponding values 2, are included in e-' 
for the first outcome, €2° for the second one and €2" for the third outcome. 

In Table 10.2 we represent the Bayes pointwise TTF estimates. obtained for different 
intervals of a prior uncertainty ©, = {6/.6/’] and ©» — [65.64] for the sample sizes 
n = 0,50, 100. In order to learn the behavior of the posterior Baves TTF estimation. 
we give in Table 10.3 the TTF estimates for the larger number of samples. During the 
0.1488. 67 0.05109, 6;°" = -0.04. 6," = 0.02 which 


0.9639. By inspecting the analysis given in Table 10.2 


modeling we have chosen mz 

corresponds to the TTF value R 
and Table 10.3, we conclude that with increasing the sample sizes the Bayes pointwise es- 
timate approaches the real TTF value. This pattern is common. It appears more frequently 
in calculating variants where the uncertainty interval has been chosen more successfully. 
As seen from Table 10.3, the pattern of approaching the posterior TTF estimate to its real 


value is nonmonotonic. This is explained by the randomness of the modeled samples. 


Statistical Reliability Analysis Posterior Bayes Estimates 293 


10.3.4 Bayes TTF estimates for undefined parameters 


Below we represent the development of the previous results for the case where the initial 
data is given with the errors and during the testing this data is corrected in accordance with 
the testing outcomes. The essence of this problem is that the correction of initial data is 
performed only by the results of functional tests. For the research test we artificially give 
the loadings which made the system achieve the limit state, and, consequently it implies a 
failure. Thereby the observed test loading value cannot be considered as an element of a 
sample of real loading. 

Consider a situation when a TTF is estimated at the fixed time moment. Suppose, in accor- 
dance with 10.3.2, that we have found the Bayes estimate Re using the results of research 
and functional tests. The obtained estimate depends on the mean value mz and on the mean 
squared value Oz, i.e., Rs = R* (mz, Gz). This is valid, since the conditional TTF estimate 
R(0, 42) is parameterized with the help of mz and 67. In view of the uncertainty of the 
initial data, the parameters mz and Oz appear to be also uncertain. Besides, this uncertainty 
is expressed with the help of prior densities h,,(mz) and hg(Gz). One possible way of 
obtaining h,,(mz) and hg(6z) has been given in 9.4.4. 

The problem of estimating TTF for the case when uncertain characteristics, connected with 
the error of initial data, are corrected by the results of functional tests will be solved by the 


following scheme: 


1) Starting from prior densities h»,(mz) and fig(Oz) and qualitative results of functional 
tests €z = (Z1.22,---,2n) we find the corresponding posterior density fimo (mz. Oz | Z) 
with the help of the Bayes theorem; 

2) Having chosen some loss function we find the Bayes estimate Re of the function 


Ro (mz, 6z) by minimization of the corresponding posterior risk. 


To determine the posterior density Ring (mz, Oz | z) we use the known 

Bayes solution [202], based on prior densities conjugated with the Gaussian likelihood 
kernel. Instead of the parameters mz and 6z we will use the parameters mz and cz — 07 a 
following the procedure given in [202]. As a prior density for mz and cz we use a gamma- 


normal probability density 


h(mz,cz) = he (cz) hm (mz | cz) (10.49) 
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Wee wh2 ae | 1 
(Ga h-(cz;s”,v) = (=) 3 exp (~ 395%] , cz >0, v >0, 
(10.50) 


and 


1 (czn! Nae z 1 2 
hin (mz | cz) =i, (mnzim —) = wae’ [Sean (me —m') : Cosh 
The parameters of the joint density (10.49) are determined with the help of the earlier 
obtained numerical results (see expressions (9.67) and (9.68) by equating the theoretical 


moments of the distributions (10.50) and (10.51) to the corresponding calculating values: 


= => lop 
and 
(0)]? 
0. 
Rn _ oi iS | £ 53 
s [o! Vi ee (10.53) 


In the given case the sufficient statistic is generated by the following quantities [202]: 
The posterior density of the parameters iz and Ozhas the same form as in (10.49). but 


instead of n’, m’, v and v’ s’* we correspondingly use 


rt a 
nn am+nm F 


n" =n' +n, ; , wa=vtn, (10.54) 
i Seid) 


and 


vl! s!? = Vs? 4 n'm? +B 4+ mi? = nlm”. (10.55) 


; ' —_— ; 210 

With the help of these expressions we can find, in particular, the posterior mean values 77 
={0) . “2 “2 . : 

and 6, © and variances 5, and sg of the parameters mz and, 07 respectively. which correct 


the prior estimates (9.67) and (9.68) according to the experiment’s results: 


(0) nm. +n (Oe 
m7 = a! 6, =S, (10.56) 


and 


(10.57) 


Statistical Reliability Analysis Posterior Bayes Estimates 295 


So, with the help of this approach, using the conjugated prior densities, we have obtained 
the joint distribution density hme { mz, Oz | €z } which is written with the help of formu- 
las (10.49)-(10.51), where, instead of each parameter with one prime, it is necessary to 
substitute the parameters denoted by the same symbols but having two primes. The last 
ones are computed by the formulas (10.52)—(10.57) with the help of prior data and experi- 
ment results. 

The second part of the problem, connected with obtaining the final Bayes TTF estimate 
Rj" which takes into account new experimental information for the correction of the initial 
information about the numerical characteristics of initial variables is solved almost analo- 
gously to 9.4.4. The simplest way of obtaining Rx is by substituting into R the posterior 


pointwise estimates given by formulas (10.56), i.e, 


Rit = Re (my, 6)) (10.58) 
The exact solution may be found in the form 
Re = / [% (mz, 0z)hine (m2.07 | e:) dozdmz. (10.59) 
== 4/0 
In order to avoid the necessity of a double numerical integration, we represent in (mz, Oz) 


in the integrand of (10.59) in the form of a Taylor series with respect to ms and e 


Leaving only the terms up to the second order of smallness, that is, 
Ret = Re ia. 6)))) +552, +35, (10.60) 


where 


ORs (mip. 67”) a°Ri Ga 5 | 
* a aN ER ee eee so 

oe »(0)2 ee (0)2 

om, 06, 


10.4 A procedure for controlling the operational capacity of a system 


In this section we present and solve one applied problem with the operational capacity 
control of the object by the results of measurement of the key parameter. The main part 
of the diagnostic procedures used in this area is based on the binary representation of the 
control results [134], when each testing is fixed the fact of the key parameters being in the 
admissible domain or not being in this domain. In the first case, the system is regarded as 
having survived, in the second one as non-survival. We cannot say that such an approach 


is flexible enough in spite of the fact that it is simple and operative. This is explained by 
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the reason that the testing results giving the values of the key parameter which are situated 
dangerously near to the admissible domain but assumed to be as successful as the results of 
testing in which the values of the key parameter are situated far away trom the boundary. 
Besides, the control of attainment of the desired reliability level cannot be done often (for 
example, for the case of a small number of successful tests). Below we have formulated 
and solved for one case of calculating the problem of the working capacity. This problem 
enables us to make a conclusion about the attainment of the given reliability level. The 
contents of this section are based on the results of the previous one and essentially use the 


notion of the coefficient of the working capacity inventory. 


10.4.1 Setting of the problem 


Let Y be a unique key parameter, U its admissible value. We will assume that Y and U are 
random variables obeying the Gaussian probability distribution with the parameters m7): 
Oy and my and O7;, respectively. The values of these parameters are estimated betorehand, 
when we carry out the project testing of the system. Therefore. before we begin testing 
for some prior estimates, me, ed and mi ; ce are known. Since these estimates in 
a common case are very rough, we will assume also that given corresponding intervals of 
prior uncertainty: for the mean values, [m). mry) and {77).. mi/.). for the variation coefficients 
uy and vw, of the random variables Y and U, correspondingly (vy. > and va. Each 
interval will be represented with the help of the quantity A equal to a half of the length of 


this interval, i.e., we will assume that we know the values 


HW / tt Ni 
Aw My = My oS My = My 
¥ iat — oo U — =. a = 
gee Pew of 
A, = —— Ad tt 


Hence, before testing we know that {mi ay}. a \. {im," Ay \ ic ee where 
= ofl = of 

During the experimental data processing we carry out ” independent tests with a modifi- 
cation, fixing the values of key parameters Y and admissible value U. For each j-th stage 
of testing during which / tests have been carried out, the testing results generate a sample 
ul m (40) Mes yy) and a! homme (109 83. 6. it,) So that all the results of 7 tests are written 
in the form {y, u}, where y= y"), w= ul”), 

We will assume that given the desired probability Ryeg of fulfillment of the working capacity 


condition, Y > U. The problem is to construct the control procedure for the fulfillment of 
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the condition 
Ry = Rj (ey, eu!) > Rg (10.61) 


for each j-th stage of testing and obtaining of the conclusion about the fulfillment of the 


requirement about the reliability of all n tests. 


10.4.2 A problem solution in the general case 


To find a more laconic writing of the control procedure, we introduce the so called working 
capacity inventory coefficient g = my /my. The probability of fulfillment of the condition 


Y > U under the given values of vy and vy is written as 


g—1 


\/ 92ve +07, 


R>P{Y—U > 0} =m 
which allows us to find from the condition 


=! 
@ 2 Re 
Vert % 


the least value of the coefficient g guaranteeing the fulfillment of the reliability requirement: 


L— [1 —(1=v3.)(1 —aeqve)) 


10.62 
ae (10.62) 


ee ee eS 


where Zreq is the quantile of the normal distribution of the probability of Rreg. The idea 
of construction of the control procedure consists of obtaining the posterior Bayes lower y- 
confidential ei 8 (Eu, ey) and comparing this limit with greg. To ensure the possibility of 
such a construction we give the following arguments. Choose as RJ in the condition (10.61) 
the Bayes lower confidence limit E and assume that the variation coefficients VU and VY 


are known. In view of the monotonicity of the function 


ae | 
R(g,vu vy) = & | —S (10.63) 
\/g2ur + v2, 
with respect to the variable g the following relation holds: 
P{Ry > Rreq} = P{R (z,; vu,vv) > R (req, Vu; w)} (10.64) 


Since only the posterior probabilities are considered, one should use instead of the values 


vy and vy their posterior estimates Py and Py. Hence, it follows that the condition of 
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reliability (10.61) is fulfilled, if the following inequality for the estimation of the inventory 


coefficient of the operational capacity of the system: 
8, (Ey, £4) 2 8req(Pu, Fy). (10.65) 


where freq (Vu. ty) is determined by formula (10.62). and the problem is to obtain the 
Bayes lower confidence level ay for the inventory coefficient. 
For obtaining 8, we find the posterior density f(my. mi)  €u. €y) and apply thereafter 
the Bayes estimation procedure for the function of two random variables my and my; of 
the form g = my/my. Under the assumption, Y and U obey the Gaussian distribution. 
Therefore, the kernel of the likelihood function fo (my .my: €u. €v) with given oF and oy 
is written as 

Lo (my, mu | Eu, ey) = exp 35 (mi, — 2iimy ) _ — (my _ 2imy)| : 

20; 20; 

where a and ¥ are correspondingly the sample means for U and ¥. Assuming that in the 
intervals of a prior uncertainty my and my obey the normal law. we obtain the following 


relation for the posterior density of the parameters my and my 


n 2 ~ n 2 crease 
h(my,my | €u, Ey) ~ ao(my,my) =exp se (mt —2aimy ) — = (my -25m9)] 
my <my <my, my <my <my. (10.66) 


Following the concept of the Bayes confidence estimation, we determine the value g. with 


the help of the following equation: 


my “my 
|| ag (my. my )dmydme: — ¥ dame | ago (my ote Vdimy (OIG) 
ae 2(x,) my u 


th) ny 
where the domain Q(g.) containing the unknown limit &, represents by itself the intersec- 
tion of the domains @, (¢,) — { (my mn) smy > gnu } and @) = amy: Se ea ee aS 
my < my | the values of the variances oF and OF are replaced by the corresponding poste- 
rior estimates. 
The control procedure given below has an algorithmic nature and cannot be reduced to 
simpler calculations. The essential simplification may be achieved only for calculating the 


case with a constant admissible value. 


10.4.3. Calculating the case of a nonrandom admissible value 


Assume that Y obeys the normal law with the parameters my and oy, and the admissible 


value U always takes on a nonrandom value uv. The probability that the condition of the 


Statistical Reliability Analysis Posterior Bayes Estimates 299 


operational capacity of the system holds, that is, 


ahs eel 
R-P{* > 1} -0(£"). (10.68) 


The value of the inventory coefficient of the operational capacity of the system guaranteeing 


the fulfilment of the requirement about the reliability Rreq is determined in accordance 
with (10.68) by the formula 


oY 
8req = %reqT— +1, (10.69) 


where Zreq is the quantile of the normal distribution of the probability Rreq. From this point 
we will follow the scheme of 10.4.3: using the results of testing €y we estimate the lower 
confidence limit By for the coefficient g = my /u and control the reliability behavior of the 
system with the help of the condition gy 2 req: 

For the construction of the Bayes posterior estimate of g = my /u, we use the known solu- 
tion, based on the conjugated prior distributions [202]. As in 10.4.2 we will assume abso- 
lute error A,, and Ag of the prior distribution of the parameters my and Oy are given, i.e., we 
suppose that [my,. my | is the interval of a prior uncertainty for my, where my = m\ —ie, 
my = m\? + Am, and for oy [oy, o/], where of = on +AGy = a In accordance with 


[202], the prior distribution for my and cy = Oy 2 has the form 


h(my, cy) =he(cy )Am(my | cy), (10.70) 


Va 2env /2—1 
a ae! 


© 


exp (-3's?er) ~ cy SO SO 


(10.71) 
and 
1/2 
hm(my | cy) = (or) exp [Seva (my -m!)) ; (10.72) 


The parameters of the densities (10.71) and (10.72) are determined by a priori known nu- 


merical characteristics ml), Am, a Ag, analogously to the formulas (10.52) and (10.53): 


(02 
m’ =m!) = (10.73) 
nm 
(0)2 
90 
s =o)" and v'=—% (10.74) 
oO 


For obtaining ye myy/u we need to know the posterior density hm (my /éy), where ¢y 


is the posterior estimate of the parameter cy. In accordance with the theory of conjugated 
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prior distributions, for the Gaussian case the desired posterior density is determined [202] 


by the expression (10.72), but with other parameters, i.e. 


i Nly 
éyn [Pe 2 
ha(my {ey = exp |—<éyn" (my —m")? |, (10.75) 
2X D 
where 
iets a y/ 1 -] 
rn =ntn, m = i Ill (By = Ba s+ nln! nD ni? — nm" . 
n+n y 


In accordance with the concept of the Bayes confidence estimation. lower confidence limit 


my with the confidence level y is determined by equation 
| Xm (my | éy )dmy = ¥. 
My 


Having performed the necessary calculations, we finally obtain 


ml!" l 
= — —-Z_y ——_ 10.76 
ue Hh at ucyn! ( ) 


which allows us to control the attainment of the reliability level Rregwith the help of the 


condition g > P 
§ y Sreq 


Example 10.1 (A numerical example). Suppose that the required level of satisfaction of 
the operational capacity condition Ryeg = 0.99 while the admissible value of the parameter 
u = 3.5. A priori we are given mt @ 4.72, Agen ee = 0.4, Ag = 0.1. The required 
value of the operational capacity inventory is greg = 1.266. As seen from the example 
conditions, under the system elaborations the given TTF is ensured since my mu = 1.349 > 
Seq: 

During the experiment the first five tests, we demonstrate the following values of the key 
parameter Y : vy = 4.85, yp = 4.90, v3 @ 5.08. vge= 3:60. ye = 3.85. In Fige 10. 30ve depiet 
the empirical curve of change of the estimate g, ,. As seen from the graph, after the fourth 
test the condition of fulfilment of the reliability requirement is broken. This implies some 
correction that results in the following values of three successive tests vg = 5.26. v7 = 4.94, 


yg = 5.08. The curve % a) has returned to the domain of required reliability. 


As was mentioned in Chapter 9, a lot of engineering methods of calculation constructions 
and technical devices use essentially the notion of the safety coefficient without taking into 
account the random nature of the system parameters. The value of the safety coefficients 


are chosen, as a rule, from a wide range which are not connected in practice with the real 
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Baw 


Fig. 10.4 Estimate for the Safety Coefficient as a Function of the Coefficient of Variation. 


peculiarities of certain systems. If one applies the methods of a probability projection, i.e., 
chooses the system parameters in accordance with the required probability of its work- 
ing capacity, then this shortcoming is eliminated, since the notion of a safety coefficient 
is not applied under the probability projection. As an example of this circumstance, we 
may choose the problems given in Chapters 8-10. However, due to the inertia of existing 
deterministic approaches to the projection (in particular, projection of the construction ele- 
ments), safety coefficients will be used in practice for a long time. Therefore, the problem 
of development of the method of statistical estimation of the safety factors, applied for the 
calculations of certain objects, is very important. This method must, above all, take into 
account the required TTF level, probability characteristics of the parameters of the inves- 
ligated system, and experimental data that let us verify the working capacity model of the 
system. 

In this section we formulate and solve the problem of statistical estimation of the safety 
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factors for the typical enginecring method in the case of a Gaussian distribution of the 


status variable. 


10.4.4 Setting of the problem 


Suppose that Q = @(X) is a carrying capability of the system, represented in the form 
of a function of independent initial variables X — (X).X2..... X,) containing in particular 
the mechanical characteristics and geometrical parameters for the construction elements. 
Denote by S the acting loading. The system is assumed to be operating if the condition 
@(X) > S is satisfied. The quantities composing this inequality are random. thus the in- 
equality holds with certain probability. 

Using the deterministic approach, we should use as object parameters the mean values my 
and my of the corresponding random variables Q and S. Here we use the condition my = 
nNms, i.e., the loading mean value is made 77 times as large as it was in order to compensate 
for numerous random factors and imperfections of the theoretical model: Q = 01X) leads 
to the calculating value of the carrying capability my. Thus, the safety coefficient has the 
sense of a quotient of the mean value of the carrying capability obtained by a theoretical 
approach, to the mean value of the acting loading, i.e., 7 = mg/ms. 

Using the working capacity model with additive error considered in Chapter 9, we write 


the working capacity condition in the form 
Q+mgeé—S>0; (10.77) 


€ in this inequality has the sense of relative error of the theoretical dependence) Q = @(X),. 
and obeys the known distribution fe(€:@). The parameter @ is, generally speaking, un- 
known, but we are given the prior density 4(@) which concentrates by itself information 
about the error €. [tis assumed also that we know the distributions of probabilities of the 
random variables Q and S. 

During the object design we can carry out such an experiment that may give us the factual 
level of carrying capability. Assume that in each of 1 independent tests the object is put in 
the condition of destruction, Le., in such a condition when the applied loading will be equal 
to the factual (not calculating) carrying capability. In each j-th test we measure the values 
of destruction loading sj and the values of all initial parameters included in the vector xj. 
This enables us to find the theoretical value of the carrying capability gj; = @(x;). Since 


during the test a failure is observed, i.e., the condition g; + my&; — 5 = 0 holds, there is a 
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possibility of determination of the factual value of the relative error €;: 


Ss; -qj 
gj =+~—,, j=1,2,...,n. (10.78) 
ae 
The problem is to find the posterior estimates of the safety coefficient 7 to account for the 
described set of the initial data and required value Ryeg of the probability of fulfillment of 


the condition (10.77). 


10.4.5 The case of Gaussian distributions 


Suppose that Q = N(mg, dy), S = N(ms, Os), and € = N(me, Oc), where we know the 
quotients vg = O¢/mg and vs = Os/ms, which are called the variation coefficients of the 
theoretical carrying capability Q and loading S. The numerical characteristics me and 6, 
are not given, but given the intervals of their prior uncertainty, correspondingly [a,b] and 
[c,d], where, me = U(a,b), 6g =U (c,d). 

For the Gaussian quantities Q, S and €, the probability that the operational capacity condi- 


tion (10.77) holds is written in the following way: 


mg — ms + mg: me, 


\/ 93 + Of + m2,o2 


This probability is easily represented in the form of a function of the safety coefficient 7, 


R=® 


depending also on the parameters me me, O¢, Vg and vs: 


n(1+m,)—1 


\ /von? ae va es 1’moo? 


Having equated R(1)) = Rreq and using the expression (10.79), we obtain the equation for 


R(n) =® (10.79) 


the safety coefficient, corresponding to the required TTF level 


1/2 
n(l+m,e)-1= zrea( Mm +v3 +102) ; 
where Zreq is the quantile of the normal distribution of the probability of Rreq. In the domain 
7 > 1 this equation has a single root 
1/2 
(War me)? + Zreq Ee is vs _ ZreqYOVS + (1 a Zreq¥S) O; a5 mevs| 
(1+ me)? — Zaq (vf + 92) 


Since the variation coefficients vy and vs are known, we will emphasize the dependence of 


n= (10.80) 


the safety coefficient on the parameters of the model error, i.e., 7) = 1) (me, Oe). 
The procedure of estimation of the coefficient 7 is followed further on by the standard 


scheme of Bayes estimation. Using the sample of the sample results € = (€1, Spe. En) 
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determined by the formula (10.78) and assumption € > N(m,. 6, ). we write the likelihood 
function 


€(me, Oe | €) = l(me, O¢3V1, V2) = ony ; ae v2 — 2mev, +m; 1 


oa 


and the testing statistics 


Since the parameters m, and O¢ have uniform prior distributions corresponding|s in the 


intervals [a,b] and [c,d], the posterior density h (me. O¢ e) satisfies the relation 


n n ; 2) 
h (mm. | e) ~ ao(me, Oc) = on exP |- 22 (v2 —2mev} +m) 


E 
me € [a,b], O¢ € [c,d]. (10.81) 


Using a quadratic loss function, we will find the pointwise posterior estimate of 77 In the 


form 


ae 1 b rd 
A =i i) 1 (Me, Og ag (me, Oe \dmedoz, (10.82) 
a ‘< 


where 


b pd 
B al / ao(me, Og med Oe. 
a iG 


For the posterior variance we analogously have 


1 b rd es 3 
Oe ~- al | 1“ (me, Og )ao(me, Oc \dmedoe — H**. (10.83) 
a (e 


As some guaranteeing estimate of the safety coefficient, the upper contidence limit of the 
quantity 7 may be used, this is determined in accordance with the concept of the Bayes 


confidence estimation, from the equation 
/ i ao (me, Oe)dined de = 7B (10.84) 
/J0(n;) 


in which the unknown estimates lic in the integration domain. The last one appears to be 
the intersection of the rectangle [a,b] x [c,d] and the set of values of me and m,, determined 
by the inequality 1) (me, O¢) < fy. 

The calculations from the relations (10.82)-(10.84) assume using numerical methods of 


double integration and solutions of transcendental equations. 
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10.4.6 Numerical analysis of the obtained estimates 


In order to clarify the influence of different factors on the behavior of estimates of the safety 
coefficient, we have to carry out numerous calculations using formulas (10.82)-(10.84) for 
a wide range of values of initial data. 

In Table 10.4 we represent calculated results with vg = vs = 0.05, se = (v2 — Da 10403 
and the following a priori information me € [—0.10;0.10], 6¢ € [0.01; 0.06]. For each value 
of the variate parameter we have determined three estimates f)*, Gp and 75.9 represented 
in Table 10.4. As seen from Table 10.4, the increasing of the statistic v; implies decreas- 
ing of the safety coefficient. This tendency may be easily interpreted. That is, vj can be 
interpreted as the sample mean for the relative error €. When v; < 0, it displays the pre- 
ponderance of the negative values or €; in the experimental data €. If such an experimental 
value is realized, the event s; < qj, i.e., the factual carrying capability Si, is less than the- 
oretical one gj. In other words, from the experimental results it follows that theoretical 
model Q = @(X) implies the overstating of representation about the carrying capability. In 
the alternative situation, when v; > 0, we meet the preponderance of the events sj > Giis 
that is, in this case the theoretical mode] understates in preference the factual carrying ca- 
pability. It is clear that for compensation of model error in the first situation we need to 
choose a greater value of the safety coefficient. 

The behavior of the estimate 19 . in accordance with the change of the variation coefficient 
of the loading vs is given in Fig. 10.4. The cause is the presence of the random scattering of 
the loading and factors of carrying capability is the second reason of introducing the safety 
coefficient. The random nature of the loading is well determined by the variation coeffi- 
cient. Increasing of the loading implies increasing the safety coefficient. The quantitative 
nature of these circumstances is illustrated in Fig. 10.4. 

Note one more peculiarity appearing in the calculating experiment. In the case when the 
empirical data, expressed by the statistics v; and s¢, lie near the corresponding indetermi- 
nacy intervals [a,b] and [c,d]. Increasing the length of these intervals doesn’t give us an 
appreciable change in the estimates of the safety coefficient. Hence, we may conclude the 
following: we should not choose narrow intervals of prior uncertainty for the parameters of 
error for the theoretical working capacity model. Besides, based on this argument, we have 


more chances for not observing experimental results that contradict the prior information. 
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Table 10.4 Bayes estimates for the safety coefficient. 


Ree = 0.999 


Rreq = 0.9999 


1.3412 
0.0202 
1.3670 
1.3231 
0.0203 
1.3490 


0.0131 
E2GiS 


1.4304 
O25 
1.4657 
1.4072 
0.0276 
1.4425 


1.3043 
0.0187 
1.3283 


1.3830 
9.0255 
1.4156 


Fig. 10.5 The estimate for the safety coefficient as a function of the variance. 
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